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ABSTRACT 

Volume lY of a toxix volume report on the^r results of a 
nat iona^f^tudy of the Upward Bo^^^ (HBo and Educational Talent Search 
(ETS) pr^gjcams focTises on Upward Bound itself. The first three 
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(3) perceptions of UB by participating students, (4) student outcomes 
as a function of UB participation, and, (5) student outcomes as 
related to project characteristics. Findings of the evaluation 
include the following (1) UB do^? not appear to represent a single 
intervention treatment^ or even "two or three clearly delineated 
treatments; pursuit of the genei^al pbjectives of the UB program 
appear to be common across proj^C'^s^ but particular programmatic 
emphases and assumptions relative to the attainment of the general 
objectives showed considerable variation among projects; (2) projects 
appear to^ be adequately staff edV with individuals of acceptable 
levels of formal training and e^cperience for their positions; (3) 
although the overall program exhibits considerable variability, 
particularly in the academic coi^^Ponent, UB seems to be effective in 
providing and delivering the ba^ic activities required by the 
-guidelines; (4) students involved in the UB pro jects appear positive 
about staff and their program experience; and, (5) projects appear to 
be compatible with and an integirai a^id accepted part of their host 
institutions. (Author/AK) 

Documents acquired by ERIC include many informal unpublished materials not available from other sources, ERIC makes every 
effort to obtain the best copy available. Nevertheless, items marginal reproducibility are often encountered and this affects the 
quality of the microfiche and hardcopy reproductions ERIC J^akes available via the ERIC Document Reproduction Service (EDRS). 
"O not responsible for the quality of the original document. Reproductions supplied by EDRS are the best that can be made from 
'nai. , 



ERIO 



RESEARCH TRIANGLE INSTITUTE 
CENTER FOR EDUCATIONAL RESEARCH AND EVALUATION 
RESEARCH TRIANGLE PARK, NORTH CAROLINA 27709 



FINAL REPORT 



22U-889 



A STUDY OF THE NATIONAL UPWARD BOUND 
AND TALEI^T SEARCH PROGRAMS 



VOLUME IV 

EVALUATION STUDY OF JHE UPWARD BOUND PROGRAM 



Graham J. Burktieimer 
Jay R. Levinsohn 

Helen P. Kob 
Arthur M. French 



-April 1976 



U.S. DEPARTMENT OF HEALTH. 
EDUCATION ^WELFARE 
NATIONAL I NSTITUTE OF 
EDUCATION 

THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY>AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIGIN- 
ATING IT POINTSOF vfEW OR OPINIONS 
STATED DO NOT NECESSARILY REPRE- 
SENT OFFICIAL NATIONAL INSTITUTE OF 
EDUCATION POSITION OR POLICY 



CO 



Prepared for 



s^^Office of Planning, Budgeting, and Evaluation 
^ U.S. Office of Education 

^ Contract No. OEC-0-73-7052 

The research' reported herein was performed pursuant to a contract with 
the Office of Education, U.S. Department of Health, Education, and Welfare. 
Contractors undertaking such projects under government sponsorship are 
encouraged to express freely their professional judgment in the conduct of 
the project. Points of view and opinions stated do not, therefore, neces- 
sarily represent official Office of Education position or policy. 



2 



7 * -^^ ■ 

PREFACE AND ACKNOWLEDGEMENTS 

A Study of the National Upward Bound and Talent Search Programs , the 
final report of the research conducted by the Research Triangle Institute 
under USOE contract number OEC-O-yS-yOSZ , is presented in four volumes: 

Volume I, Review of the Literature Relevant to Upward Bound and 
Talent Search Programs * 

Volume II, Estimates of the Target Population for the Upward Bound 
and Talent Search Progra ms, ^ 

Volume III, Descriptive Study of the Talent Search Program * 

Volume IV, Evaluation Study of the Upward Bound Program * 

The authors, in preparing Volume IV of this report, wish to express 
their special appreciation for the cooperation and contributions of a number 
of people both within and outside the Research Triangle Institute (RTI) . 

Valuable, thorough, and constant professional guidance was provided 
throughout the course of the study by the project officer for USOE, 
Dr- Robert Berls, of the Office of Planning, Budgeting, and Evaluation 
(OPBE) , and Dr. Sal B. Corrallo, Director of the Po.stsecondary Programs 
^Division, OPBE. 

The following members of the Upward Bound/Talent Search Advisory Council 
made valuable contributions to the overall design of the study and also aided 
in reviewing and revising this report. (The organizational affiliations of 
Advisory Council members and of the other consultants listed in subsequent 
paragraphs are presented in Appendix A)": Dr. David Ballesteros, Mr. Marcus 
Bell, Dr.. Robert Berls, Ms. Lois J. Carson, Mr. Alan Clarke, Dr. Sal B. 
Corrallo, Mr.' David Johnson,- Dr. John Rison Jones, Ms. Rosalia Martinez,' 
Mr. Walter Mason, Mr. Graysoti Noley, Mr. Alexis Poliakoff , Mr. Silas Purnell, 
Ms. Janis Sanchez-Hucles, Mr. Frank Sandage, Ms. Faith Spotted Eagle, 
Mr. Rudy Tamez, and Dr. Stephen J. Wright. In. addition to their involvement 
as Advisory Council members, Mr. Noley and Dr. Ballesteros were members of 
Upward Bound site visit teams. 

As consultants to the Office of Planning, Budgeting, and ..Evaluation, 
USOE, Drs; Albert E. Beaton, R. Gary Bridge, Charles L. Thomas, and Vincent 
Tinto reviewed and made valuable suggestions for the analysis plans for the 
study. - . _ * 



The following consultants to RTI provided guidance and assistance 
in sevefal, phases of the study: Dr. Joseph Battle, in all phases of study 
planning and in site visits; Ms. Anne Borders-Patterson, Dr.' Duane Brown, 
Ms. Susan Kerner-Hoeg, and Mr. David Clayborne, in the development^ of 
instruments; Ms. Ann White, in providing planning information on UB 'oper- 
ation and recordkeeping at the project level; and Mr. Fred Sedorchuk^ in 
.providing information from the national Upward Bound data bank. 

The following RTI staff members were on the project team throughout 
the course of the study and provideiLvaluable assistance in planning and 
implementing the study and in writing and editing portions of this volume:' 

Dr. Jane W. Bergs ten 

Dr. Junius .,A« Davis . . • 

Dr. George H. Dunteman ' " 

Dr. Roderick A; Ironside 
Mr. Timothy McAdams 
Dr. John N» Pyecha 
Mr. David H. Stuart 

The following persons from various departments in RTI made contributions 
to the planning, site visit,* instrumentation, sampling, data collection, 
data analysis, and report preparation activities of the study: . 
Ms. Vivian E. .Adkins: data processing and editing. 
Mr. Steve A. Batchelor: site visits. - 
Mr. James R. Batts: dava processing. ^ 
> Pr. Charles Benrud: sampl3 selection and standard error computation. 
Ms. Lol ; Bressler-: data processing and editing. 
Ms. M. T. Bridges: sample selecition. , 
" Ms. Sophie K. Burkheimer: drafting, 
> Ms. Judy Bui;nham: sample selection ♦ 
Dr. Alyin M. Cruze: planning. 
Ms. Susan Friedman: data processing. 
Ms. Linda Higgs: report typing; 
Ms. Linda Hoffmann: report typing. 
Mr. Donald W. Jackson: data collection. _ , 
/ Ms. Hazel R. Jolley: data analysis. 
/ " " ' . • 

•4 



iv 



Ms. Cynthia A. Kenyon: Plannihg. , 

Mr. Donald A* King: planning and data ccllection. 

Mr. Milas G. Kirkpatrick: data collection. 

Ms* Mae B. McLendon; site visits. 

Mr. Dana Marnell: data processing. 

Mr. Mark R. Montgomery: data analysis. 

Mr. Archie M, Nichols: site visits and data collection, 

Ms. Celestine Ramsey: report typing. 

Dr. John A. Riccobono: instrumentation. 

Ms. Mary Ann Rowland: standard^ error computation. 

Ms. Linda Shaver: report typing. 

Ms. Lucia A. Ward: site visits. 

Ms. Jilene Weber: sample selection and standard error computation 
Ms. Mary B. Woodside: data processing. ^ ■ . 
Ms. Brenda W. Young: report typing. 
Mr. Charles Younger: drafting. 



TABLE OF CONTENTS 

Page 

PREFACE AND ACKNOWLEDGEMENTS \ . . ^. iii 

TABLE OF CONTENTS vi 

LIST OF TABLES ^ ix. 

LIST OF FIGURES . • . xvii 

EXECUTIVE SUMMARY ^ xviii 

Chapter i. Introduction .1.1 

I. GENERAL 1.1 

■ .II.. BACKGROUND \ ... J .... ^1 . 1 

III. DEVELOPMENT OF TIIE STUDY DESIGN 1,4 

IV. ORGANIZATION 0^ THIS VOLUME .1.15 



Chapter 2. The Study Design, Methodology, and Procedures 2.1 

I. INTRODUCTION . . . .' \ 2.1 

. II. CONCEPTUAL FRAMEWORK . . . , 2.3 • 

III. STUDY- OBJECTIVES 2.13 

IV. SAMPLING PROCEDURES , 2.14 

V. INSTRUMENTATION • 2.18 

VI. DATA COLLECTION, RECEIPT CONTROL, AND MANUAL PROCESSING 

PROCEDURES 2.29 

VII. DATA BASES AND COMMONALITIES 2.39 

VIII. OVERVIEW OF DATA PROCESSING 2.45 

Chapter 3. Overview of Analysis; General Approach and Limitations . 3.1 

I • • GENERAL 3.1 

II. ORGANIZATION OF ANALYSIS: SPECIFIC ANALYSIS QUESTIONS . . 3.5 

III. INSTRUMENT RETURi; RATES AND DATA QUALITY 3.10 

IV. REDUCTION OF STUDENT DATA FOR ANALYSIS AND FURTHER 

LOSS OF STUDENT. DATA 3.22 

V. . DATA RELIABILITY 3.25 

VI. DIFFERENCES BETWEEN RESPONDENT SUBGROUPS 3\30 

VII. SUMMARY 3.40' 

\ ■ • 

6 

vii 



' Table of Contents (continued) 

• . , ' Page 
.Chapter 4. Characteristics of the Upward Bound Staff' 4.1 

I. GENERAL • • *. ^ * 

II. DEMOGRAPHIC CHARACTERISTICS OF THE.UB PROJECT STAFF .... 4.7 

III.. EDUCATIONAL BACKGROUND., TRAINING, AND EXPERIENCE OF, 

THE UB PROJECT STAFF » . 4.15 

IV. WORK ACTIVITIES AND WORKLOADS OF UB PROJECT STAFF 4.31 

V. UB PROJECT STAFF ATTITUDES TOWARD EDUCATION AND UB 

STUDENTS . . . ^.51 

VI. SUMMARY . . , . . .^^ ' . . 4.64 

Chapter 5. Characteristics of Upward Bound Projects ........ 5.1 

I. GENERAL . 5.1 

II. - OVERVIEW OF PROJECT OPERATION \ ^ 

III. PROGRAMMATIC CHARACTERISTICS ' 5.13 

IV. INTRAPROJECT RELATIONSHIPS 5.20 

• V. RELATIONSHIPS WITH OTHER GROUPS AND ORGANIZATIONS 5.28 

VI. COST ANALYSIS 5.47 

VII. PROJECT STAFFING PATTERNS . 5.66 

VIII. SUMMARY ; 5.70 

Chapter 6. Perceptions of the Upward Bound Program by Participating 

Students . 6.1 

I. GENERAL . 6.1 

II. EXTENT OF PROGRAM PARTICIPATION 6 . 2 

III. FIRST SOURCE OF INFORMATION ABOUT UB 6.5 

IV. PARTICIPATION IN AND EVALUATION OF UB ACTIVITIES 6.7 

V. EVALUATION OF ASPECTS C]" PROGRAM OPERATIONS IN THE 

1973-74 PROGRAM YEAR . 6.13 

VI. "student benefits . . . . 6.17 

VII.-:: SUMMARY . 6.25 

■ 1 

... ^ \ 

Vlll 



Table or Contents (continued) • 

• . . . Page 

Chapter 7, Student Outcomes as a Function of UB., Participation . . .,7.1 



I. GENERAL 7.1 

II. PREPROCESS AND EXTRAPROCESS DIFFERENCES BETWEEN THE UB 

AND CS GROUPS AND RELATED ADJUSTMENT TECHNIQUES ....... 7.9 

III. DIFFERENCES IN EDUCATIONAL COOTI^UANCE BETWEEN UB AND 

CS GR0U7S . 7 . 30 

IV. DIFFERENCES BETWEEN CS AND UB: STUDENTS ON FACTORS 

RELATED TO SUCCESS IN PSE ^ . 7.42 

V. OTHER STUDENT OUTCOMES 7.61 

VI . SUMMARY 7 . 64 

Chapter 8. Student Outcomes as Rel ated co Frp - ject Characteristics . 8.1 

^ I. GENERAL 8.1' 

II. RELAtlONSHIP OF PROCESS VARIABLES TO' STUDENT OUTCOMES : 

DISCRIMINANT ANALYSES . 8.26 

* " • • ' 

III. RELATIONSHIP OF PROCESS VARIABLES TO STUDENT OUTCOMES: 

PvEGRESSION ANALYSES . , . / 8.47 

IV. SUMMARY , 8.66 

Chapter 9. Summary and Conclusions . . 9.1 

I. PURPOSE, DESIGN, -AND METHODOLOGY I . ■ 9.1 

II. SL^IARY AND INTERPRETATION OP MAJOR FINDINGS: 

CHARACTERISTICS OF UB PROJECTS, STAFF, AND STUDENTS .... 9.7 

III. . SUMMARY AND INTERPRETATION OP MAJOR FINDINGS: 

ATTAINMENT OF BASIC UB OBJECTIVES ' '. . 9.21 

IV . SUMMARY AND INTERPRETATIONS OF MAJOR FINDINGS : ' 
THE RELATIONSHIPS OF. STUDENT OUTCOMES TO PROJECT 

CHARACTERISTICS \ , . . ' ?A 



8 



Ix 



LIST OF TABLES- 



Table ' ; / ^ * ' * Page 

^. 2.1 ' Simplified Transition Mat?:ix for Progress Through- 

' ^ Stages of Education . . ' , 2,9 

2-2 Student Cohorts Points- of Data Collection, and Estimates 

. ' of Proportions ..Con?:inuing Education \ . . 2.12' 

2.3 Basic Instruments Used in the Upward Bound Evaluation and • 
Their Acronyms ... 2.21 

2.4 - -Description ot Data Source Groups and Data' Collected /. . . 2.41 

2.5 Connnoiiaiity of Student Questionnaire Data ....,!)... 2 . 43 

2.6 .Commonalities for Project Staff Questionnaires . . . . . 2.46 

3.1 An Outline of Analytic Questions . . . .^3.6 

3.2 Original and ^rre^ted Student Sample Sizes , . 3.12 

3.3. Instrument Return Rates ^. . : . . 3.L4 

3.4. ' Percentage of Respondents, with Questionable Data Quality 

for Individual Questionnaire Items 3.18 

3.5 Percentage of Itemi^ with Questionable Data Quality for 
Individua], Respondents 3.19 

3.6 • Extent of Unavailable and Inconsistent Data in Student 

.\ = Master File . . . . . *. . . . . . 3.24 

3.7 Percent Agreement Between UB, Student Reports and Project 

Staff " Reports for Selected Variables. 3.27 

3.8 Percent Agreement Between CS Student Reports and High 

, . School Staff Reports for Selected Variables -.3.28 

'3.9 Differences Between BSQ(B) Respondents' and D/TQ(C)': 

Respondents on "Selected Variables " . 3.-32 

3.10 ^ Differences Between BSQ Respondents and D/TQ Respondents 

on Selected Variables • 3.34 

3.11 *?)ifferences' Between FSQ(A) Eligibles and FSQ(B) Respondents 

on Selected Variables ..^ 3.36 ' 

• 

• '3.12 differences Between. FSQ(A) Respondents and FSQ(A) 

Nonrespondents on Selected Variables' 3.39 

•> " 
4.1* Approximate Staiidard Errors of Estimated Percentages 

^ for Chapter 4 .... ..... tf.6 

4.2 Age of UB Project" Staff Members 4.8 

4.3 Sex of UB Project Staff Members 4.8 

■4.4 Ethnicity of UB Project Staff Members ..." 4,10 

■4.5 Community of^Residence of UB Project Staff 4,11 



9 

xi 



List* of Tables -(dontinued) * / - . 

Table ^ /^"^ ' ' .^-V £SSi 

2f.,6 Highest Educational Level of Fathers afld^Mbthers ^ * 

of UB Staff Members . . *. .. . • . \. ....... i 4 ,12 

.4.7 Occupatiqn of-F^th^rs and, Mothers of UB S^aff Members . . . *4.14' 

4.8, Highe'st Educations^ level Obtained- by .UB' Project ^taff . . 4.16 

'.4.9L- Current 'Rir oilmen t in a Degree^ Program by UB Project Staff. 4*.l6' 

' 4.10 UB Staif Attendance in Training Institutes Offering 

^pecifi^^rraining in Teaching, Counseling, or Program 

T Administration for ."Disadvantaged" Students . . -4.18 

• ^ ' ^ ' / ' : ' . " ' . 
.4.11 " Attendance in -Position Related Training r.stitutes Since 
' : . Becoming UB Projeqt Staff Member \. . ^ . ^. -4.19 

4% 12 Inser^ice Trainitig of UB. Project Staf^^nstructor^ . . . • 4.19 

4^.13 ^ Number of College Courses^Specificailly -Related to 
^ * Counseling CoiJpleted by UB Counselors 4.20 

4.14 '^Hpu:j:s of Supervised Counseling" Practice Experienced by" . : 

UB Counselors'^ ^. . . i . . . ; . u t . ^ . . . 4 . 21 

4.15 Type of Teaching Certificate. Held by7UB\Staff Instructors . 4.23 

4.16 ■ Total Experience of UB Project directors \in Programs for ^ 

Disadvantaged- Youth r . . y . . • • / . 4.23 

4.17 Experience of t?^ Project Directors ^in Administration of . * . 
Programs for Disadvantaged Youth . . . . .\. ....... 4.24 

4.18" 'Experience of UB Project Directors with Programs for 

Disadvantaged Youth in Other Than* Administrative Capacity . 4^25 

A. 19 UB Instructors' Years of Teaching Experience in.Full-Time 

and Part-Time Positions . 4 . 26 

4.20 Experience of UB Project Irisrructors in Related \ 
Instructional Positions .\ 4.28 

4.21 UB Counselors' Years* of Counseling Experiencfe in Full-Time 

and Part-Time Positions ..... .'^ i. ..... .4.29 

4.22 Experience of UB Project Counselors in Related Counseling 
Positions ^ .... 4.30 

4.23 ' Median Percent o£ Working Time Actually and Ideally Spent 

by Project- Directors on Various Activities • • • 4:33 

4.24 Median Percent of Working Time Actually and Ideally Spent 

by Instructors on Various Activities 4 . 35 

4.25 Median Percent *of Working Time Actually and Ideally. Spent 

by Counselors on Various Activities- . . . ....... . . . 4.36 

4.26' Extent of Upward Bound Employment of Instructors^ . . . ". .,4.40 

4.i27 Other ■ Employment of Upward Bound Instructors Not Employed 

Fuil-Time ^Duripg the 1973-74 Academic Year ■ ' -. . 4^.40 

• ^ 10" ■ V 

xii' 



List of Tables (continued) ' - ; * 

. Table ' . Page 

. 4.28 Extent of Upward Bound Emplo3mient of Counselors, 4,41 

4.29 Other Employment of Upward Bound Counsellors Not Employed' 

Full-rTime During Che- 1973^74^ Academic Year 4.41 

H>30 s Number of Classes Taught by Full-Time and Part-Time' - J . 

Instructors 4\43 

.4.31 Instructors^ Reported Use of Various Instructional . ^ 

Practices or Techniques in Upward Bound Projects . . . . . 4.44 ' 

• 4.32 Median Percentage of Counseling Time Spent on Various 

Student- Concerns ^ 1 . 4.46- 

4^33 « Numbers of different Students Counseled' per -Week in 

Individual and Group Counseling Sessions by Full-Time- 

and Part-'Time Counselors 4i47 

4.34"* 'Average Length of Counseling Session in Individual and 

Group Counseling Sessions by Full-Time' and' Part-Time ' 
Counselors ^s. . . ^ . •. . . ^.49 

^.35 'Average *Number of Counseling Sessions Held With a'Given 

Upward Bound Student ... ^. 4. 50 ^ 

4.36 UB Proj^ect Directors' Ratings 'of ' Goals Within Their ^ - ^ 
Philosophy of Education ..... ^' * ......... *4. 52 

4.37 <^ UB Project Instructors' Ratings' of Goals Within Their 
•v ' Philosophy of Education ...... 

4.38 , UB Project Counselors'' Ratings of Goals Within Their 

Philosophy of Education . . . . .. . .. . . . . -. . . .. . . 4.54 

4.39 Ranked Median Orderitig of the UB Proj ect* Staff s' Ratings 

of Goals Within Their Philosophy of Education . . v. . ; . . 4.56 

•4.'40 UB Project Directors' Ratings of Students in Their^ ' 

Projects'- .• ... -4.58 

4.41 UB Project Instructors '• Ratings of Students in Their 

Projects * ' ..... 9 ... . 4.59 

4.42 UB Project Counselors' Ratings of Students in Thedr 

Projects . ^. ...... .\. , 4.60 

I ' ■ 6 " -. - * 

,4.43 ' Ranked Median UB Staff Ratings of Students on Several 

Dimensions . . . . ' . . . . - . . 4.61 

^ 4*,44 UB^'^Project Instructors' Ratings of the Importance of the'* 

Things They do in Teaching 4.63 

5.1 Approximate Standard Errors of Estimated Percentages 

^or. Chapter 5 • 5.3 

' { • . 

5.2 Courses, Tutoring, Counseling, and Other ActivJ-ties 

Provided by UB Projects . . ^ . . . . ,^ . . . 5.14 

5.3 Project Directors' Ranlcing of Emphasis^ Placed on Various 
Program Functions .- 5.17 

' 11 • ■, \ ' 

^ ' . xiii » , ' 



List of Tables (continued) 



'5.4 ' Instructors' Rankings (Aggregated by Project) of 
. ^ Emphasis Placed on Various Program Function^ . , . . . 5.18 

5.5"^ Counselors' Rankings (Aggregated by Proj ect) of ' ^ 

Emphasis Placed on Various Program Functions . . , . \ . ^5.19. 

3*6, Support of Instructors and Oounselors by the Project 

Director' t . . " 5.22 

' ■ ■ 

.5.7 Intergroup Relationships in the Project as Evaluated 

by .Project Diirec^tors . . 5.24 

5.8 Intergroup Relationships in the Project. as Evaluated 

by the Project's Instructors 5.25, 

* 5.9 ^ Intergroup Relationships in the Project ..as Evaluated^-. 

' by the Project's Counselors . ' * 5.26 , 

5.10 Administration of Various OtTie^r Programs by Host • ' 
Institution and Project Cooperation with Such Other 

Programs . , -j''^* ^ 5; 30 

5.11 Project Directors' Ratings of the Degree of Support 

Received from Various Groups ^ ^ ; . 5.32 

.-r ' / . 

5.12 Existence an^ Quality of Recommendations Received by 

Various Groups * as, Perceiveu. by Project Directors . . . .. .5,33 

5.^13 ^ Cooperation Project deceived from High Schools^ and 

Postsecondary Institutions: Instructor Ratings . . . 5.37 

5.14 Cooperation Project Received from High Schools 'and . * ' ^ 
Postsecondary Institutions: Counselor Ratings ...... 5; 37 

5.15 Project Directors' Reports of Operation- of and Cooperation 
With Other Programs in the Same Area. . . 5.40 

5.16 Exis-tence and Frequency of Meetings of Various Upward ^ 
Bound Advisory Committees .^^ ............. 'J ... 5 . 44 

5.17, Existence and Ef f ectiveiiess of Various Types^ of Services ' 
, • by Parents or Community Groups . - . 5.46 

5.18 Average Costs of Upward Bound Projects, by Sources of 

Funds • ... 5.51 

5.19 Average Contributions of Sponsoring Agencies or 
^InstitutionsT to Upward Bound Projects, 1973-74 ... . ... . 5.55 

5.20' UB Project Total Costs Classified by Type ^ of 'Sponsoring ' ^ 

A luDtitution for 1973-74 Program Year . ^ . . ... ... . . .5.62 

5.21 ' UB Project Total Costs;r Classified liy Location, of Project 

Students ... ^ J ...... 5.64 

5.22 Descriptive Profile of Upward/Bound Project Staffing 

Patterns by Summer and Academic Ye$ir Programs . . . . . 5.^7 

* * 

xiv 



■ / ■ ^ 

List of Tables (continued) 



' by Summer and Acaf' ir c>^rams 

6.1 - Approximate Standard Errors of Estimated Percentages 

for Chapter 6 .... 6.3 

e 

6.2 Number of Upward Bound Sessions in Which Students had 
Participated, by HS Grade Level . 6.4 

6.3 Students' First .Source of Information About Upward fibund ... 6.6 

* 6.4'. Availability of Activities to Students and^Rates of Their 

Participation . . . .\ d*o 

6.5 \ Ratings of Helpfulness of Upward Bound Activi^.es by 

\ Participating Students . . . . . . . . . . .-x. ...... 6.11 

6.6 . Students' Evaluation of Various Aspects of the 1^73 

Summer Program /• • 6.14 

6.7 Students' Evaluation of Various Aspects of the 1973-74 

. . Academic Year Program 6.16 

6.8 .^Perceived Importance and Receipt of Potential Benefits 

of Upward Bound Part^icipation ................ 6.19 

6.9 Perceived Changes in Opinion About the Students After 

Upward Bound Participation .... . . . 6.24 

7.1' Demographic Characteristics of "the Student Groups . ... . 7 .11 

7.2 ^ Academic Background of the Student Groups . . . . ..... 7.14 , 

7.3 Example of Balancing Technique Using Hypothetical Data ^ 

. ' ^ ^ * Relating to Grade Point Average and Poverty Status .. • • / .*Ld - 

- 7.4 1 .Percentage of Student Groups in Balancing Categories by 

;/ High Schboi Grade Level in Fall 73 ............ . 7.19 

•7.5 Percentages of Upward Bound Participants and Comparison 

. Students Living in Specif ic Locations ... . ...... 7.21 

7.6 Educational Attainment of Parents of UB Participants 

and Comparison Students 7.23 

7.7 Occupational Level of Parents of UB Participants and 
.Comparison Students . . . . . . 7.24 

7.8. Previous High School Course of Study and Participation 

in Intervention Programs for UB^'* Participants and 

Comparison Students 7.27 

■ ...•/.-' 

7.9 Percentages of Upward Bound Participants and Comparison . 
Students Receiving Specific Services from Intervention 
JPrograms Other Upward Bound 7.29 

7.10 Fall 73 to Spring 74 High School Continuance/Completion 
Rates by Grade foi; Upward Bound Participants and 

Comparison Group . 7.31 

■ v: •.. ■ - • . • ' ■ ^ . ' -13 • . 

ERIC - 



List of Tables (continued) ■ ' 

Table . .. Z£S£ 

7.11 Differences in Fall 1973 'to Spring 1974 High School 
Continuance/Completion .res ^ de for UB Participants 

as a. Function of Length of JearL -xpation 7.34 

7.12 Fall 73 to Fall 74 High Schuo Continuance/Completion 
Rates by Grade for Upward Bound , Participants and 

Comparison Group • 7 . 35 

7.13 Postsecondary Enrollment Rates for Upward Bound 
Participants and Comparison Students . .... . . * . • • 7.38 

7.14 Probabilities of High School Completion and PSE Entry, 
Given Tenth Grade Entry, as a Function of ' Degree of 

Exposure to Upward Bound 7.41 

7.15 Change in Academic Grade Point Average From Ninth Grade to 
Current Grade for Upward Bound Participants ^and Comparison , 
Students " • 7.44 

7.16 Changr. in Proportion of Academic Credits Passed' from 
Ninth Grade to Current Grade for Upward Bound Participants 

and Comparison Students . • «• ■7«45 

7.1? Change in Proportion of Academic Credits Taken from Ninth 
Grade to Current Grade for Upward Bound Participants and 
jf^ Comparison Students .7.46 

7.18 Planned Entry into Postsecondary Education Within Four 
Years for Upward Bound Participants and Comparison 

Students by Grade in School ........... 7.48 

7.19 Highest Educational Attainment Desired and Expected for 

~ Upward-Bound^Participaats^-and„CQmparisoiL_^^ . ^ ... 7.50 

7.20 Desired and Expected Occupations of Upward Bound 
Participants and Comparison Students . . . , . 7.51 

7.21 Numbers of Preliminary Actions Taken Toward PSE Entry 
by Upward Bound Participants and Comparison Students 

by Grade 7.53 

7.22 Numbers of Postsecondary Institutions to Which Applications 
Were Made by Upward Bound Particip-ants and Comparison 
Students .7.54 

7.23 Acceptance into PSE of Upward Bound Participants and 
Comparison Students 7.56 

.7.24 Application for. Offer of, and Adequacy of Financial Aid 
for Postsecjbndary Education by Upward Bound Participants 
and Compar/son Students 7.58 

7.25 Amount of Financial Aid for Postsecondary Education 
Offered from" Selection Sources to Upward Bound Partici- 
pants and Comparison Students • • .7.60 

7.26 . Particip.ation of Upward Bound and Comparison Group High 

High School Dropouts in High School Equivalency Education 
Programs (HSEEP) . . . k . .7.62 

14 

xvi 



List of Tables (continued) 

Table ^age 

7.27. Percentages of Upward Bound Participants and Comparison 

Students Applying to Specific Types of PSE 'Ins titutions . . 7.63 

7.28 Types of Postsecondary Educat^^on Institutions Entered 

by Upward Bout irticipants and Comparison Students • . . 7,65 



8.1 Sample Si" ^ onse. Rat:es for UB Projects ...... 8.6 

8.2 Summary St. ' ^ :or Data Availability and Aggregate 

Value of Prepj.o -iss Student >leasures 8.9 

8.3 Summary Statistics for Data Availability and Aggregate 

Value of Student Outcome Mea^^^es . 8.10 

'8.4 Frequency Distributions* of Pxroject^ on Five Student 

Outcome Measures . . . . • . . , • . . • • > 8.11 

8.5 Frequency Distribution of PrC?3^cts on Average Change in 
Student Academic Grade Point ^^verage • • 8.12 

8.6 Frequency Distribution of PrC?Jects on Average Change in 
Student Academic Course Load . • - 8.12 

■ 8.7 ■ Project Level Process Measures ^ 8.15 

8.8 A Priori Project Groupings ................. 8.16 

8.9 . Project Level Process Composites • . 8.23 

8.10 Average Values of Project Inp^t and Output Variables for 

Each of Six A Priori Project Classifications .8.30 

8.11 Raw and Standardized Cluster ^eans for Clustering Solution 

. Based on Three Outcome Measu^^^s . _ . . 8.32 

8.12 Cluster Means for Variables Selected in Discriminant 
AnaLysas_of _.the_0_ujt.cP_me_MeasM^ 8.36 

8.13 Raw and Standardized Cluster ^^eans for Clustering 

Solution Based on Postsecondary Measures 8.40 

8^14 ' Cluster Means for Variables Selected in Discriminant 

Analyses of the PSE Outcome J^easuxre Clusters . . . * • • • ^-^^ 

'8.15 Summary of Stepwise Regressi*^^ Analyses for Seven Project 

Output Measures , . 8.51 

8.16 Postsecondary Entry Rate RegX^essed on Three Project Input 

Variables, Project Size, and Three Instructional Practice 



Factors , - — . — . — , — . — — . . ... # . . ._8.„54 

8.17 Fall-to-Fall HS Continuance/Completion Rate Regressed on 
Three Project Input Variable^ Project Size, and Three 



Insrructional Practice Facto^^^ 8.54 

8.18 Four-Year College Enrollment Rate Regressed on Three 
Project Input Variables j''' Pro j ^ct Size, and Three 
' Instructional Practice Facto^^s ' , 8.55 



15 

xvii 



List of Tables (continued) 



Table ' . ^age 

8,19 Postsecondary Entry Rate Regressed on Three Project 
Input Variables, Project Size, and Six UB Functional 
Emphasis Factors . . . • . . .. .... . . . . . . . . . . 8.57 

8.2^ . Four-Year College Enrollment Rate Regressed on Three 
Project Input Variables, Project Size, and Six UB 
Functii \ Emphasis Factors • • • ^*59 

8.2 '^ll HS Continuance/Comp > dtion Rate Regressed on ^ 

. iiiree x^roject Input Variables, Project Size, and Six UB 

Functional Emphasis Factors 8.60 

8.22 Summary of Stepwise Analyses for Regression of Student 
Outcomes on Measures of Summer Program Activity Level in 
Specific Functional Areas 8.63 

8.23 Summary. of Stepwise Analyses for Regression of. Student 
^ Outcomes on Measures of Academic Year Program Activity. 

Level in Specific Functional Areas .. . . . 8.64 

8.24' Summary of Stepwise Analyses for Regression of Student 

Outcomes on' Effectiveness of Functions Performed by. Parents 

and Community Groups 8.6^ 

8.25 Summary of 'Stepwise Analyses for P ssion of Smdent 
Outcomes on Support Received from ' ous Groups and 
Agencies ♦ 8.6 



/ 



16 



xviii 



LIST OF FIGURES 



Figure ■ Page 

1.1 A Conceptual Model of Upward Bound 1.7 

2.1 A Simple Process Model 2.4 

2.2 A Simple Process Comparison Model i . . . 2.6 

2.3 The Structure of the UB Student and Control Student 

Samples 2.17 

2.4 Simplified Pi ^ess Model of Upward Bound • . . • 2.26 

2.5 Flow of Data Collection Activities for UB Students . . . 2.31 

2.6 Flow of Data Collection for CS Student ...... ^- ... . 2.33 

2.7 Decision Tree for Determining Comparison Student 

Fall 1973 Status 2.52 

' /,-•' . 

5.1, Total Year Project Cost as a Function of Average Number 

of Svs^aazs Served . 5.58 

5.2 UB ^ -ii -ler r'—gram Total Costs as a Function of Number 

of Sc^ enz^ Served 5.60 

5.3 UB Ac:^de3ii±c Tear Program Total Costs as. a Function of 

Number cf 3nidents Served ..... r • 5.61 

8.1 Profile^j .f Clusters Empirically Derived From Three 

Studerc O'ltcome Measures • • • 8.35 

8.2' Profii:.^:s ot the More Effective and Less Effective Project 

Clusters far the Set of Discriminant Function Variables . 8.3S 

8.3 Prof Iss ox Project Clusters Empirically Derived from 

Fou: rSE Ouiccome Measures 8.42 

6.4 Profi_^es oi the PSE Gutcome Clusters for the Set of 

Disrr inzLxant Function Variables 8.45 



17 



xix 



Executive Summary 
Evaluation Study of the Upward Bound Program 



Volume IV of ' 
A Study of the National Upward Bound 
And Talent Search Programs 

.. . I. BACKGROUND AND PURPOSE 

Under authority of the Economic Opportunity Act of 1964, as amended (42 
U.S.C. 2809), the Office of Economic Opportunity (0E;0) funded 17 Upward Bound 
(UB) projects, as a pilot program in. the summer of 1965. In 1966, UB was author-^ 
ized as a 'national program under Title II-A of the Economic Opportunity Act, On 
July,^l, 1969, responsibility for the program was transferred from OEO to the 
U.S. Office of Education (USOE) , Department of Health, « Education, and Welfare . 
(HEW). Currently, UB is authorized under section 408'/of the Higher Education 
Act of 1965, as amended (20 U.S.C. 1068). .w. 

UB was designed to reach low-ir^come high school students uho have potential 
for successfully completing a postsecondary education^ , program but^^ who, due to 
inadequate preparation or lack motivation, arel prevented from seeking higher 
education or from meeting conventional criteria for acfinission to a college, 
university, or technical institute. Through the use of remedial instruction, 
exposure to new or altered curricula, tutoring, cultural enrichment, and counsel 
ing, the program is designed to generate in such individuals the skills and 
'motivation necessary, to enter and successfully complete postsecondaryy education. 

During the summer, UB students typically reside on a college, university, 
-or secondary school campus for an intensive six to eight week session, taking 
courses, attending cultural and social events, and receiving counseling. In the 
academic year, they typically receive less intensive attention: they may attend 
Saturday classes, attend periodic tutorial/counseling sessions, or participate 
^ in occasional cultural enrichment activities. During their junior and senior 
years of high school, they receive guidatice in exploring options for postsecond- 
ary preparation" and the program best suited to tsjieir needs. 

In July 1973, USOE awarded the Research Triangle. Institute (RTI) a contract 
(OEC~0-73-7052) to plan and conduct an evaluation of the UB and Talent Search 
(TS) programs. Several sources were consulted in designing the study, including 
the enabling legislation^, the official guidelines, selected program personnel, 
current and former UB staff personnel and students, and three study advisory 
panels. The planning study was conducted from July 1973 to January 1974; the 
actual studies were implemented and conducted from Febnuary 1974 to March 1976. 

The primary goal of the RTI study was. to evaluate -two of the program's 
major objectives: (1) to increase the high^ school retention rate of its parti- 
cipants and (2) to increase the rate of 'entry of its participantsS^nrd post- 
secondary institutions. Evaluation of the legislatively mandated >objective — 
attainment of skills and motivation necessary for . postsecondary success — was a 
secondary goal of the study, primarily because of practical problems involved in 
determining and measuring the nature and degree of such skills and motivation. 
Another secondary study goal .was to provide a detailed national description of 
the UB program, including characteristics of the staff and students, their 
perceptions of the program, and project operations and costs. A final study 
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goal was to examine project characteristics in relation to attainment of program . 
objectives. 

II. METHODOLOGY 

The study utilized a quasi-experimental design in which a sample of UB 
students and comparison studenta^-were followed through a short period of time. 
The design was basically cross-sectional, with the collection of some retro- 
spective and short-range longitudinal data. 

^ Multi-stage probability sampling techniques were employed. Of the UB 
projects operating in the United States during the 1973-74 program year, 54 were 
selected after stratification on student ethnicity,' number of.st:^r1e! 
project location, project emphasis, and type of host institution. Ail partici- 
pants in the sampled project who were in grades 10, 11, or 12 were selected, 
yielding 3,710 UB students in the final sample. The comparison population was 
defined as students in the same grade levels and high schools as the UB students. 
For each selected UB project, an average of two high schools providing students..^ . 
to' that project were selected. From sampled classrooms in each of these schools, 
a total of 2.,340 comparison students (about: 21 per sampled school) were ' selected 
after stratification on grade level, ethnicity, low income status, and academic 
risk. The final sample of UB project staff included project directors from all 
54 selected projects and a sample of 104 counselors and _ 211 instructors. Also, 
15 of the 54 sampled .,UB projects were selected for site visitation. 

Data were collected through questionnaire responses., interview responses, 
and student records. Very low return rates were experienced with only one 
student questionnaire which was directed to dropouts who were difficult to 
locate and probalbly le"ss niotivated to respond. In total, over 98 percent of 
students in both the UB and comparison groups, responded to at least one ques- " 
tionnaire. The minimum return rate for staff questionnaires was 73 percent for 
UB instructors,. Complete staff data (i. e. , questionnaires returned by all 
sampled staff In a project) were available for only one-third of the projects 
sampled, but in about 70 percent of the projects, questionnaires were, available 
from the pro j ect': director and from at least half of the sampled counselors and 
instructors. In all, the extent of indeterminate data for returned question- 
naires had no serious impact on the analysis. 

For analyses, sampling weights were used where feasible in computing the 
various statistics as unbiased estimates of population parameters. Weight 
adjustments were made for both item and instrtiment npnresponse. To evaluate the 
attainment of basic UB objectives, a series of analyses focused on comparative 
student outcomes of UB participants and comparison students. Differences between 
'these populations cn such factors as grade level, sex» race , academic risk, 
poverty 'status, and general region, srate, district, ^r school-specific educa- 
tional environments were reduced by the sample desigi. or by a posteriori statis- 
tical adjustment of the comparison group's indices. 

III. SUMMARY AND INTERPRETATION OF MAJOR FINDINGS 

A. .-..irtainment of Basic UB Objectives 

■ Increasing the Rate of High School Completion - 

Fall-to-spring high school c<3ntinuance rate within each of grade 
level= 10, 11 y and 12 is slightly higher for the UB group than for the 
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comparison group~signif icantly so for grades 10 and 11. Jlegardless of grade 
level considered, however, these continuance rates for both groups were quite 
high, ranging from 93 to 98 percent. Within the UB group, fall-to-spring contin- 
uance rates for twelfth graders tended to increase with the length of time 
students had spent in the UB program. Fall-to-fall high school continuance 
rates are lower for both groupsV jagging from 85 to 93 percent. The only statis- . 
tically significant fall-to-fall rate difference was for grade 10, in which the 
UB students showed higher rates (93 percent versDUS 86 percent). Further, these 
rates do not appear to be related to the extent of UB participation.. These- 
analyses do nofe^ indicate that the UB program is "^Hpinif^f^ ' .sing high 

school completion among its participants. For Uii and similar auudents, the 
estimated probarility of completion of any'given high school grade is high (85 
percent cr above); the estimated probability of completing the twelfth grade, 
for a student who enters the tenth ^grade is about 70 percent, regardless of UB 
participation. ' - ' 

2. Increasing the Rate of JLncry Lnto Postsecondary Education (PSE) 

Among high school gradua.tes, 47 percent of the Comparison students 
entered PSE as compared to 71 percent of the UB participants. Among all indi-- 
viduals who could have entered PSE (i.e., those not still in high school, includ- 
ing dropouts), 65 percent of UB students entered PSE as compared to 43 percent 
of comparison students. There ^is also evidence that among high school graduates, 
PSE entry rate is positively relared to length of participation in the UB program. 
That is, 78 percent of the students who had participated in UB in grades 10 ' \ 
through 12 entered P'SE, 69 percent of the students who had participated in UB in 
grades 11 and 12 entered PSE, and 68 percent of the students who had participated 
in UB only in grade 12 entered F5E. Of those UB students ' entering PSE institu- 
tions, about: 75 percent enrolled in four-year colleges or universities, about 20 
percent entered two-year junior or community colleges, and the remaining students 
entered vocational, trade, or other schools; comp/arable figures for the comparison 
group were about 45, 30, and 25 persenc, respectively. 

Given these results, it appears that UB participation is positively related 

to immediate entry into PSE. A plausible explanation for this relationship 

(though not the only one) is that U3 program participation raises the probabiijity 

of student entry into PSE. - ^ - ' 

3. Generating Skills and Motivation Necessary for Success in 
Educat^ion Beyond High School 

Analyses indicated the UB program helps students in preparation for" 
PS^, including the applications process. The data further .indicated that propor- 
tionally more UB than comparison students apply for financial aid. Although UB 
aid applicants do not receive more offers of aid, they do receive more adequate 
offers, generally in rhe form. of larger grants. There was nb apparent relation- 
ship betveen UB partiicipation and changes in academic measures from ninth grade , 
to current grade in terms of grade point average, proportion of academic credits 
taken, and academic credits passed. There is evidence, however, that greater 
proportions of UB parrticipants planned and expected to attend and complete PSE. 
These results suggest that the UB program is providing supportive, advocacy, and 
advisory services thnt facilitate entrance to PSE. 

4. Student Evaluations of UB Projects 

Students involved in th-^ J3 projects appear positive about the staff 
and their program experience, T'r.o Tcuality of the curriculum, of counseling, and 
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tutoring, and of overall administration is perceived to be quite high, as is the 
pattern of staff and student interrelationships. The self-reports of the students 
strongly suggest that they are incorporating program objectives into their own 
-behavior, -self -cj?>nc_ept, and asp The average ratings of academic year 
program elements were slightly lower than those '^~f comp a* ? Le-elemopts in tn 
summer program. Students perceived the U3 program's ce ^.1 funct- and 
day-to-day operations of tearhin^, ccm.,. ;eling, and admini Ion . ) c w ^Il 

conducted and organized. They consitler-^d th^ best qualities of the program to 
be the staff *s interest in the students and the harmonious relationships among 
the staff and among the students. They also prized highly the staff's willingness 
to accept student suggestions. Of the potential benefits attainalDle f rom UB 
participation, students rated gaining a better .understanding of the need for 
education- and being prepared to gain admission ro college or other types of 
schools as being most important. At the same t:::^e, not all students find all 
project activities helpful. / 

B. Characteristics of UB Projecrs, Staff, > and Students 

A major finding,, supported by the site visits and the analyses of questipri- 
naire responses, is that UB does not appear to represent a single intervention, 
or even two or three clearly delineated interventions. Variation, rather than 
commonality, was the salient aspect of program description for most of the 
dimensions considered. Within the general limits established by program guide- 
lines, projects varied extensively in the kinds of students served and the Ways 
in which specific intervention strategies were implemented. Pursuit of the 
general program objectives appeared to be common across projects, but particular 
objectives and -emphases given them showed considerable variation among projects, 

1. Project Costs ' 

In the program year from 1 July 1973 to 30 June 1974, 416 UB projects 
ireported serving 51 ,'755 clients at a cost of $38.3 million. Of the 416 projects, 
67 served approximately 12,200 veterans and 9 special demonstration \)rojects 
fserved approximately 980 students, Th^ estimated average yearly total cost per 
project (excluding in-kind contributions) was $111,986 for the 1973-74 program: 
For the 1973. summer program, the estimated cost was $63,769 per project or 
approximately $830 per student . served; for the 1973-74 academic year program, 
the estimated average -cost-was $51,863 or approximately $7y)0 per student served. 
Over 90 percent of these monies were contributed by fedei:^ sources. There was 
considerable variation in the cost figures reported for projects. The range of 
reported total costs, excluding in-kind contributions, was from $9,792 to $175,000 
during the summer program and from $19,500 to $134,000 during the academic year. 
Nonfederal support ranged from $0 to well over $100,000, with the preponderance 
of projects reporting no nonfederal funding. Projects reported receiving an 
average of $9,149 worth of in-kind contributions, such as office space, facilities 
and personnel services, although these estimates are suspected to be low. 

Examinations of project costs and project characteristic'^, indicated the 
number of students served was positively related to tor:al project costs, These 
results are not surprising as project funding is deterrrlned by a formula which 
accounts for the number of students to be served. No zactors were observed that 
would suggest institutional or urban-rural inequities in funding. 

2. Project Activities and Services • 

A wide range of courses and classes,' tutorin^, and counseling services, 
. sport's, social and cultural activi::ies, and medical and dental services were 



•. offered by projects during '^^b +*he' s ummer arid acaJ year programs Tutoring 
and counseling servicer v "lly offered by a' ^^nects d .nr both 

sessions, but there wa::. > /ar lability in the vility of otti r activi- 

ties. A greater variety oi : eemed to be av- liable during the f^ummer 

program than during the academic ytji'. The Activities most conunohiy available 

— W^eTre--aiso-e-har-acterij:^ed„by tJ^^ participation rates among those students 

for whom the activities had been ava^lable^'^nd:^^^^ were considered 

• to be the most helpful among the students Vho had participated. Although the 
overall program exhibits considerable variability — particularly in the academic 
year component — UB seems to be providing and delivering the basic activities 
required by the guidelines. 

3. Relations with Host Institutiong ^ atid_ Qther Supporting" Groups 

UB staff reported receiving at least moderately , effective support from 
their host institutions , their advisory committees, arid other parent and community 
~_-Srpups. The staff and students reported good relationships ainong thefeelves, 
suggesting that in most projects the directors, staff, and students formed a 
highly cohesive group. Almost all of the project dirfictors rented their host , 
institutions (primarily public and private colleges and universities) as being 
Supportive.. Evidence of host institution Support and commitment to specified 
project.:^, and to the UB concept in general, was also obtained in site visits. 
Directors reported cooperative relationships with other programs for the disad- - 
vantaged which operated in their areas (both those administered by the same host 
institution and those administered by other institutions). UB instructors and 
counselors also reported receiving a high degree of cooperation from high schools 
and PSE :f nstitutibns. Such- cooperation is important since UB projects typically 
depend en high schools for recrui.ting students, providing school records, and 
developing complementary programs of study for students. Additionally the 
projects depend on PSE institutions for processing applications, granting admis- 
sion, administering financial aid, and providing for the needs of students in • ' 
- the institutions. Many project directors interviewed during site visits felt 
the need for more assistance, monitoring, feedback, and direction than they were 
currently receiving from the central and regional offices- of USOE. A common 
concern across projects and regions was the timing of notification of funding 
. and consequent late funding. , 

4. Project Staff 

On the average,- the projects were staffed by one and one-half full- 
time equivalent (FTE) administrative employees and three FTE support staff 
during both the academic year and summer Programs. The major staffing difference 
between the two program components was for instxiactors and counselors, with an 
average of 4.3 of these service daJLivery employees during the academic year and ^ 
11.5 during the summez: program. There was considerable variation about these 
av^'-^ra^e staffing profiles, but no significant associations were found to exist 
between project staffing patterns and other project characteristics- 

Most staff members were young (age 35 or less)- Nearly all project directors, 
and over half of the instructors and counselors, were male. The greatest propor- 
tion of project directors were black, while the greatest proportioi^ of instructors 
and counselors were white.. Projects appeared to employ staff of the same ethni- 
city as the student participants, though n.ot always in the same proportions. 
Most of the staff had obtained at least a bacheJ^or s degree, with slightly more 
. than half having obtained- a degree at the luastex's level or higher. In general, 
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the course work and training completed by the UB project staff appeared directly j 
related to their job needs. Over a third of the staff reported current particir- 
pation in continuing leducatidh," and over half had attended workshops on teaching, 
counseling, or program administration for disadvantaged students. ^ In addition 
to formal training and education, UB project staff generally had considerable 
practical experience in their field of work, but less experience working speci- 
fically with disadvantaged students. 

All staff members, including project directors, performed a number of 
acclivities in common, principally, teaching and Counseling. Most staff members 
appeared to be carrying reasonable work loads, and to be directing; their energies 
efficiently. Instruction tended to be oriented toward group discussion or 
individualized ^instruction, and competition was jieemphasized; 

There was cn extremely high degree of agreement in the ratings- of educational 
goals by project directors, counselors; and instructors. In general,' the staff 
agi^^Bd that the more important goals of education were developing student enthu- 
siasm for learning, helping students to feel important, and providing students 
with a solid grasp of fundamental skills. Instructors 'rated the following 
behaviors to be most important in their teaching: encouraging students to 
become involved, giving students praise and affection, answering student ques- 
tions, . encouraging .students to make choi^ies, and diagnosing individual learning 
problems. i^^I^^^-- ^ 

5. - R'a i^f uitji^^ Characteristics of Students . ^ 

Ufi^.t'iid%n't)? most frequently reported first hearing about the program 
froin ether UB'^fniii^ Other sources from which substantial proportions of 

students first heard of the program were school guidance counselors, UB staff 
members,; .and school teachers. These results support observations that formal 
student recruitment was carried out in most projects by ''contact counselors" in 
the feeder high schools. Responsibility for the final selection of students, 
using various criteria but generally considering factors such as family income, 
grades and aptitude test scores, teacher and counselor recommendations, evidences 
o£ student motivation, and personal intuition, was assumed by UB project directors 
and staff. 

About 51 percent of the UB students were black; 18 percent were white; and 
20 Percent either American Indians, Mexican Americans, Puerto Ricans, or. Orientals 
Approximately 56 percent of UB students were, female. Approximately 85 percent 
of the students were 3^ to 18 years of age; and approximately 15, 39, and 45 
percent were 'in grades 10, 11, and 12, respectively. ^ Based on ninth grade 
academic information which was typically prior to UB participation, slightly 
more than half of the UB students were classified as "academic risks.". On an 
ind^x that is closely related but not identical to federal poverty-level guide- 
lines, approximately two-thirds of . the UB students were considered to be at or 
below poverty level. About one-half ":the parents of UB students had attained a 
formal education equivalent to or greater than a high school diploma. UB students 
were seen by directors, instructors, and counselors as most proficient in peer 
rela^ons and creativity. General academic ability of students was rated to be 
above average by all stafl. The^ lowest ratings were given to , student attitudes 
towa^rd authority and toward school, self-concept, and attention span. ^ 
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Although most UB students appeared to be the kind for whom the program is 
intended, , the definition of the target group with regard to potential for academic 

^achievement appeared to vary because of lack of specificity, operatiorial'fe'asx^ ' c 

bility, or differences in interpretation among 'staff , in various projects. Some' 
of the resulting differences in the UB participants among projects. may represent 
a desirable heterogeneity, but this'^ heterogeneity appears to result from vari- 
ability in personal convictions or preferences of project staff or from lack of ^ 
precision .in definitions specified in the legislation and guidelines. This is 
not to 'state that ineligible or undesexrving students are being served , . but. that 

/a variety of kinds of disadvantagement are probably now represented in different 
projects. ' ^ 

The Relationships of Student Outcomes to Project Characteristics 

The relationships of project characteristics with average student outcomes ' 
for the project sites j^ere analyzed. Poverty status, grade-poitit Average in the 
ninth" grade, academic risk, sex, and similar pre-UB measures of stfedent charac- ^ 
teristics had strong relationships with outcome measures such' as PBE entry 
. rates, changes in grade-point averages, and types of PSE entered. Relationships 
between outcome measures, and UB staff characteristics, types of instruction, 
counseling, and tutoring were examined, after adjustments "for pre-UB measures 
and some weak relationships were found. The basic finding suggests that projects 
with lower proportions of academic risk and/or poverty level students are more 
likely to achieve the basic goal of inducing or experiencing high PSE en.try 
rates. This relationship does not provide particularly 'useful information for 
-program-level decision making , since any project can determine, through selection 
procedures, the academic and economic nature of participants (within the con- 
straints of the program guidelines) . 

Generally, the analyses did not" discover any systematic set of UB project ' ,/ 

characteristics related to success. A possible explanation of this pattern of 
findings, which is supported by observations during site visits, is that different 
approaches are"^ used by UB projects because different types of students are 
selected, and that different students are selected because a UB project *has 

^geared its approach to that particular type of student. With this explanation, 
statistical adjustments for input differences, such as those used in these 
analyses^ would tend to cancel any^ effects due to a UB process. This, explanation 

.. is quite consistent with the study findings, but to investigate/the hypothesis 
more fully would require different approaches to both design and measurement 
t^an those employed in this study. 
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Chapter 1 
Introduction ' 



I. GENERAL 

This volume constitut;es the f ourth of a four-volume report entitled " » 
A Study of the National Upward Bound and Talent Search Programs ,— ^ The 
volume describes the results of an evaluation study of' the^Upward Bound 
(UB) Prpgram — a nationwide progr&m funded by the U,S. Office of Education 
(USOE) to help selected low- income high school students prepare for and 
enter postsecondary education -^^^^"The study,- conducted by the Research 
Triangle 'Institute (RTI) , was funded by the Office of Planning, Budgeting, 
and Evaluation (OPBE) of USOE (contract number OEC-0-73-7052) . 

Under the. same contract, another federally funded program. Talent 
Search (TS) , was^also studied. The results of the TS evaluation and other 
companion studies are reported in the first three volumes. Volume I 
provides a Review of the Literature Relevant to >Upward- Bound jind Talent 
Search Programs . Volume II provides Estimates of the Target Populations 
for tfhe Upward Bound and Talent Search Projgrams , Volume HI reports the 
results of the Descriptive Study of .the Talent Search Program . 

This chapter de^scribes the UB program, presents an overview of the 
development of -the UB study design, and outlines- the organization of the 
remainder of Volume IV. Appendices of supporting documents and informa- 
tion for Volume IV have been bound separately. 

II. BACKGROUND ^ ' 

The UB program originated in the Office of Economic Opportunity (OEO) 
from pilO:t demonstration projects that operated in the summer of 1965. In 
1966, \it was authorized as a national program under Title II-A of th4 



~- A Study of the National Upward Bound and Talent Search Programs . 
Final Report :22U~889, Four Volumes." Research Triangle Park, North 
Carolina; Research Triangle Instl'tute, April 1976. 
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Economic Opportunity Act. In 1968 the Higher Education Aniendments trans-^ 
f erred the UB program from the Office of Economic Opportunity to the U.S. 
Office of Education.. The present legislative authority for \he UB program 
is/the Education Amendments of 1972 (Public Law 92-31ft^ . . 

UB was designed to reach Ipw-income high school students who have 
potential for successfully completing a postsecondary program but who, due ^ 
to inadequate preparation or lack of motivation, are preyepted from seeking 
higher education or from meeting conventional criteria for admission to a", 
college, university , at technical institute. Through the use of creative 
remedial ins'truction, exposure to new or altered, curricula, tutoring,^ 
cultural , exposure, and encoiwragement , the program is designed to generate 
in, such individuals the skills arid motivation necessary to" enter and » ^ . . 
successfully complete postsecondary education. ... . ^ ' , 

During the summer, UB students typically reside on a college, univer- 
sity, or secondary school campus for an intensive 6- to 8-week session, 
taking courses, attending cultural and social events, and receiving counsel- 
ing. ^n the academic year ^ they typically receive less intensive attention; r 
they may attend Saturday classes, attend periodic tutorial/counseling 
sessions, or participate in ^o.ccasional cultural enrichment activities. 
During their junior and senior years, they receiv^ encouragement and (guidance 
in exploring many options for postsecondary preparation and the program 
best . suited to their needs. 

Institutions sponsoring UB projects typically* are 2- or 4-year" colleges; 
in some ca^es, projects are sponsored by secondary schools or cooperating ^ 
groups of institutions. The 1968 Higher Education Amemdmeiits required 
projects to (a) establish cooperation between postsecondary institutions 
aT\d secondary schools, Cb) provide health services for program participants, 
(c) provide each student a stipend of no more, than $30 per month, and (d) 
establish a maximum cosx-per-student of $1,800 per year, with the Federal 
share of .expenditures limi^ted to a maximum of 80 percent or $1,440 per 
student. The Education Amendments of 1972 removed these requirements 
'except for the ceiling on student stipends, increasing the Federal shar^' of 
program^unding to 100 percent. 

During fiscaX year 1973, or program year 1973'-'1974, there were 416 UB 
projects operating in the United States and its territories. The UB data ..bank 
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reporting system indicates that .-.these projects served 51,755. individual 

II " 
p^i^ticipants— at ^ cost of $38.3 million during that period,. Of the 415 

projects, 67 were created specially for veterans, serving approximately 
12,200 of them in FY 1973, and, 9 were special demonstration projects which • 
served approximately, 980 students in FY 1973, according, to che UB data 
system. The present study involved only the 333 regular UB projects (not 
the Special Veterans or demonstration UB projects) operating in the coter- 
minous United St^tes'^ring FY ' 1973. ' 

The present study was deemed necessary by USOE for several reasons 
Past studies of the program have been inadequate in some respects and are, 
in mos^: cases, out of date.. Some evaluative studies of UB have been under- 
taken in the past; however, the majority of such studies have been at the 
project level (see Volume I of tKis series of reports). Many such studies 
have been discounted' as "advocacy studies . " Although the USOE maintains a 
data bank of information about current and former UB participants > this 
system is considered inadequate to provide a current, comprehensive evalua- . 
tion of. the program. • Standards available system software is focused on 
providing project-by-project or aggregate statistics (at various' levels of 
aggregation), but this data source and the related software were neither 
intended nor designed to provide data to the extent required for a compre*- 
hensive, evaluation of the program. ' - ' 

The UB program was subjected to a rather comprehensive review in 1969 
by GreenJeigh Associates, . Inc. , under contract to the OEO.— ^ The Greenleigh 
study / however, did not meet present needs in th,it: (a) the evaluation was 
conducted at an earJLy point in the history of the program, reflecting its 
operation at . that time through the OEO (substantial program changes have ^ 
been subsequently made, including transfer to the Division of Student 
Support and Special Programs (DSSSP) of USOE, changes in legislation, and. . 
regionalization.of program direction) 5 X^) It was not possible to observe 



2/ " c - ^ 

Due to participant turnover and the overlapping of project year with 

'fiscal year, the number df participants being served at a given point in 

time would-be considerably less than this figure. 

3/ 

. -Greenleigh Associates, Inc. Upward Bound 1965-69: A History and 
Synthesis of Data on the Program in the Office of Economic Opportunity . 
New York: Greenleigh Associates, Inc., February 1970. 
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the long-term effects toward retention of UB alumni in higher education; 
and' (c) certain inadequacies existed in the control groups employed. 

Another notable study of the UB" program was recently conducted by the 
General Accounting Office (GAG).— Though severely limited in scope. (m 
both kinds of data employed and numbers of projects examined), this study 
nevertheless raised serious questions as to the relative effectiveness of 
the UB program and the validity of the inf ormatioif contained in the UB data 
file. 



III. DEVELOPMENT OF THE STUDY DESIGN 

In response to a request for proposals issued by USOE in May 1973, RTI 
submitted a proposal for the planning of a comprehensive study and evalua- 
tion of two programs, UB and TS. On acceptance of the proposal by USOE, 
RTI carried out the planning study during the period of June 1973 to January 
1974. The actual studies of UB and TS were implemented subsequently, from 
February 1974 to March 1976.—^ 

This section discusses the procedures followed in formulating the UB 
study design during the planning phase, the constraints limiting the 
design, tlie resolutions of problems arising from these constraint^, and the 
main featur.es of the resultant design. 

A. Procedures 

The design of the study involved several iterative processes. The key 
aspects, however, can be summarized in four steps. The first major step in 
designing the study was to obtain a comprehensive and realistic understand- 
ing of the UB program from available existing data and past studies^. This 
step included the formulation of a model of the UB program, presented below 
in subsection III.B. The second step involved determining specific objec- 
tives of the study and attendant constraints. The third step was designing 



— ' Comptroller General of the United States. Problems of the Upward 
Bound Program in Preparing Disadvantaged Students for a Pos tsecondary Edu- 
cation . Washington, D.C.: "^U.S.' Government Printing Office, March 1974. ^ 

— ^ The present series of reports describe the results of these studies; 
this volume reports the results of the UB study. 
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alternative studies and estimating for each alternative the degree to which 
it would meet the objectives and the level of effort and time it would 
entail. The last step was choosing a final design. Several sources of 
information and assistance were consulted in carrying out these, steps. 
In order to obtain a detailed. understanding of the program and to 
devise alternative preliminary designs, several sources were employed: the 
published literature concerning UB; government documents providing the 
legislation and operating guidelines for UB projects-;-of-fi-aials of the USOE, 
DSSSP, and OPBE; senior program officers in several USOE Regional Offices; 

c 

and UB project staff and students. In addition, an advisory council was 
formed to reviei/ the UB model and the preliminary designs, and, to help in 
the other steps of the design process. 

The advisory council aided the research team by contributing its 
knowledge of UB projects, UB personnel, and educational programs fo,r 
disadvantaged youths. It was composed of members of the educational 
community, personnel involved with UB and TS at the project and regional 
.levels, and personnel from DSSSP and OPBE (see Appendix H for a list of 
members). The full council met three times during the planniiag study. 

At the first meeting, which took place ^early in the planning study, 
the advisory council suggested some changes in the* UB- model, considered the 
/preliminary stiidy designs, and discussed with the RTI research team the 
' primary objectives ^of the study and certain practical constraints in 
implementing any study. 

After the first meeting, the RTI research team developed a series of 

alternative study designs, in light of the feedback from the advisory 

council.^ At the second advisory council meeting, near the end of the 

planning phase,, these refiUed designs (ranging from a minimal cross section-- 

al study of high school seniors to a 7-year longitudinal study) were 

/ } . , ^ 6/ 

examined and the council of feredr advice regarding their preferred designs.— 

•Subsequently,' OPBE, in consultation with the RTI team" and in consideration 

of the council's recommendations, selected the study reported in this 

volume (along with the other two studies reported in Volumes II and III). 

^7 ' 

— The alternative' designs are detailed in an unpublished working paper 
prepared for USOE entitled Talent Search and Upward Bound Evaluation 
Study , 12 November 1975. 
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In ririal meeting during thisi planning pha^i^- he counciLl inst to re-^^iev 
the rues- . -nnaires a''^- net :istriimeats than tiac :sen derrdiloped by i-:-!! for 
tihe rrj^iy. 

a'- iition to the ac: ... : -y coun-cil, a stuideat panel was formed to 
re---. — ; tii-^ student quest icnz^ires and study de^' .m. This panel was com- 
of former off current HB students or stua 3 atherwise involved in 
UB i.i4is2niV.^rship of this panel is given in Apper:. H) . 

Ir., 5'ebruary 1974, the implementation of the chasen szudy began. 
Durixcr ae course of the S3:udy, the advisory c uiciL was kept informed of 
progre i by monthly newsLaizters. The council i.-^t frrr a fiitsJ. time in 
Februa' ^ 1976 to review tue present report and to suggest mndif ications 
prior to its submission to USOE. . * 

An additional advisory group was utilized during the implementation 
phase. This -was a committee formed and convened by USOE to review the . 
analysis plans for the present study^^ (see Appendix H for a list of members). 

B, A Model of Upward Bound Processes and Effects 

In planning the UB study, one of the first steps was to develop a 
conceptual scheme representing the UB processes and consequences, as well 
as other relevant factors to be considered in the evaluation. 

8/ 

Thei model, as depicted in Figure 1.1, represents in sequence— UB and 
related processes and outcomes. The boxes in page 1 of Figure 1.1 depict 
the procedures and conditions required for creating UB projects, including 
funding Ind staffing. Once projects have begun operations, they select 
studen^ts land offer a number of activities constituting the program treatment, 
as listed in the box labelled "Program Activities" (page 2 of Figure 1.1). 
These activities or treatments are intended to produce certain effects ' 
(page 3 of Figure 1.1), which are separated into those occurring: (1) 
during UB participation," "Immediate Effects"; (2) in the few (up to four) 



— The Analysis plans were presented to the committee in document 
entitled Report of Planned Analyses for Upward Bound Evaluation, Volumes 
I and II . J Research Triangle Park, N.C.: Research Triangle Institute, 
November li974. 

8/ ' i ' : ■ . • 

— Figure 1.1 is presented on three separate pages; the sequential nature 
of the processes and outcomes is represented from left to right on a given 
page. j 
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ye szs .:ft^r UE^articiperitvrr, "Intemadiate Effects"; and (3) in the longer 
ri;:.:u. "Lcng-IlAnge Effects''. T^ese intended effects may affect the UB stu- 
d£-':t£- ri:.eix\peers, or the Ti.^ ondary and postsecondary institutions involved. 
Sa5:ide3 laese intended effe::.'^3, the TB projects may also precipitate imin- 
C£r.:iec r:£sxilts, some of v7nJ.cn may be undesirable. These effects may occur 
ar r-" ^^-p^t time- periods ... ,e series of "Other Effects", page 3 of Figure 
1.1-., Anally, both the i^^nded and unintended effects within each time 
per:i.::t inny be pxodiiced or-maderated by causes other than UB, as seen in the 
boxvjs Ljaoelled "Other Causs"' (pages 2 and 3 of Figure 1.1) • 

Tne nodel does not present th.e specific processes or treatments 
through wnich the program nir\y produce the intended (or unintended) effects.,.. 
sir ic vas fmmd early in tine study that it was impossible to do this for 
the UB program a whole. The various UB projects differ quite widely in 
thexr approach or program. tneatment. They provide different courses, using 
different classroom and tutoring techniques over varying periods of t±iiie:: 
the?-^ employ different counseling techniques; and they place varying degre:es 
of -emphasis on the reaching of academic subjecrs and skills,, the nurturing 
of rhe individual's ego strength, and the broadening of cultural and social 
^r^Terierrres . Ir. part, the diversity of treatments reflects the different 
t, :es of s-tudents selected by different projects, (some choosing students 
Trr:th very poor acadeni^ rxeparation and motivation, others selecting better 
prepared and z.^xe hi^. motivated students). Th- diversity also reflects 
^ ae differing Txnilc5.oi of various project dirEcrors and other UB person- 

Viel regarding -:rDmpr=r;£:atcrr7 education. 

was rhms found rhat UB does not consist of a small numbsr of 
:x:;snrrifxable tr-^snmsnt r:ectniques with specified expected outcomes- 
^fetirisr it Ti7as detannnied r^t in some general and uns:Decif led' manner the 
cri^r^s and trcttroring offered by UB are expected to- inzzrease academic 
<^ prdmariZLy, ^nd. self-concept "and other personal strengths second- . 

zzz2j\ SimiZxHrly, '^ne individual attention, counseling, and cultural and 



s:ocial acriviri.es afforded Dy the program are intended to strengthen self— 
est^^rsm and related personal qualities, and thereby to increase interest and 
ability to learn academically. For this reason, the model simply documents 
the variety of activities snd their intended" outcomes found across the 
range of UB projov^its. ^ 
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'Once the model was specified, it -sss used to hielp identify the com- 
ponents of the UB process which could ba fruitfully evaluacec, and to help 
identify factors that should be coasiderac i-n designing a study. The model 
was thus the. starring point from whicL sev-^ral stucy designs were formu- 
lated. The primary objectives of ^ he szuc * and the considerations condi- 
tiLoning the eventual cnoice of a s ud: :af icn are r.reatv-d below. 

Objectlve£>^ Constraints, and r^esoli^vCiCins 

Some constzraints on deiiign were ±zp::ised by the na::ture cf thr= UB 
program; others were common to any atreEnr to evaluate an ongoin,:; social 
acnion program viriiLch has been in operation for several years, wirhout a 
bxcLlt-in mechanxsm for evaluation. Fi:isJJ.y, there wer^ time and budget: 
l±3itations. 

These consrraints led to a nunzber cf key declszL-ms that: greatly influ- 
enced the study design.. Some of tiie d^^—i.n ions were made excJ-usively. by the 
RTZ research team; others were nrade joirrtly with tks^ advisory council 
and/or USOE. In considering the constraints and in finding ways to t:x^*et 
them, the RTI team was guided by a basi" principle; namely. :::^at the study 
must be designed to provi^ia the Uost unbiased and s clen tlf 1 cs .'2 , t accurate 
answers possible, wirhiiU excepta. prof -assional standards, tzu the questions 
defined to be of prj:uiiary inter es: 

The mandated objective of tr 3 program is to prc^de psLrticiipants 
with the skills ana motivatloos v^^^'as^BVy f r : success edur^zrlor: beyond 
high school. Frcin. rt±s maT^I ...j:!^ , vr^ cferexmined tvc other r:b je^tl-ras 

i were implied, and Jrhe riir^ :s:j'or 3biiectrtves of the UB pxograr. were consid- 
ered to be: (1) CO IncrettSg-- the algh school- retention rates c± i-ts 
participants (or dHrrease tbeix dropcnit rates from high' school;; (2) to_ 

' Increase the rate ox ,eiizry of its students into » post srecondary institutions ; 
(3) to generate the skills and morivatlon necessary for success in education 
^beyond high school . Thi^ RTI team and the .advisory coiiricil jointly selecced 
the- first two major objectives as the primary focus for the stv.dy. Ev^u^ 
ation of the third ma.ocr objecziive was not given eqxial prioric:" f err reasons 
explained in subsexii_iQ^ III. ".J below. Specific qiisstions arri sub objectives 
to be addressed :3y .me srudy were defied during the design '"nase, and are 

35 



ERIC 



1.11, 



described in Chapter 3 • The major dr=slg- elements and the constraints 
which influenced rheir adoption are c:::^C23sed in the iallcrrjing subsectiovis . 
The actual design is presented in det:ziil in Chapter 2- 

1, Choice of a Q:.iasi-Experiinen::::al. Design. 

The RTI research team and t.ie. advisory council concurred that an 
experimental design was not poss::>^I^e- 3n an experimer.t^ design, 
students eligible zor UB would h^^ rzndonily- assigz::ied to participate in 
the UB program or r.:r a control grr^mp- 3oth the experimental UB group 
and the control gr-^np would be obssrved for given periods of time to 
determine the e£fa£crt3 of program parrtici.pat.ioii. Such a design would ^ 
be ideal' for, d&te ..^ z' J.:i ing whether U£ was having an effect on its par- 
ticipants (e,g. , c::: their rai!:es cf nigh school reti^ention and entry 
into postsecondary ed:ucration) but f. v^r many pract:;i::iiil reasons was not 
feasible. 

The RTKteam also deternni.n&d z±at it wss not feas:*'ble to use a 
natural design in -which groups^ rs^-rlrrlng drxf^emt tri^'^s of UB- treats- 
men ts would be cor::p«iirec. As -:expla±::s=ii in sizhs-^ctt^n IXI.B above, 
students served by ditfsrr^nt "Xurc^^^rzzt^ dxf ferssi marr?^ dimensions due 
to selecrtlon critsriai; aiso, rhe i:..xferent trs.anr»its given by differ- 
ent prci aces were not systemsric well defrrrT?Q.> 

Par these reasnu^, the rlTI t:ei3i; concladet th^.:-: the best alter- 
native aaoug the r-^^rr. -^r^ing az'zz±zrusi ^vas a q:i2asl— exj';iiri2nental* design in 
« which a sample of lH .endent:^ ann a, sample of ;:Qr:::^isDn students (CS) 
would be studied th~rcr:zgh a short pe-rtad of tlm. 

2. Chojzice of Cross— arectional D^^ign 

It was necessar7^ that the t30E raceive tie r^sulrs of the UB 
study no JLater tisn. tiie end uz 1F7£.. Addit:ioix^?ili . funds for the 
Study were liini:.tec, '^'^ ttrese r^iESLs:::^ , a compiet-. longitudinal 
study, favored. rhsi^ry by all rsazrtiHs invol- ed ..n planning, was not 
possible. The prirpoHHii Icsigi rirnrjnr? 1 study wo 3j:l require observing UB 
students and apxircpriate compHXXSXjn groups in n-i-Vn school and following 
them through tiiH±r scheduled datre f completi:;^ :;f four years 6f ' 
post secondary education.. This appmach would no~ have produced 
results soon enomgh to saxxsfy USGE requirements. Further, such a 
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S-Cudy would have necessitated base year observations of a larger 
:nz3inber of students than were used (to provide for adequate numbers of 
future observations) • Funds were hot available to cover a study of 
such scope* 

Because a longitudinal,, design was not feasible, a cross-sectional 
approach was selected. ' In the chosen design, samples of a cross- 
section of participating UB students and appropriate comparison stu- 
dents were to be studied at a given point in time to collect retrospec- 
tive and current data. The students were also to be followed over a 
short time period to determine whether they persisted in school. The 
chosen design posed both problems and adva.ntages which are discussed 
in detail in Chapter 2. The cross-sectional approach did, however, 
allow answers to the major questions within the time limits required 
b*- USOE.- It also required smaller samples and was thus less costly. 
T.ie study was planned, moreover, so that it would be possible to- 
esxpand it in the future into a limited longitudinal study* 
I.. Choice of Study Objectives^ 

It was explained above that the third major objective of UB was 
ti^t made a major study goal. Several reasons led to this decision. 
T2ie third major UB objective (a'nd the one mandated in current legisla- 
tion) is "to generate the skills and motivation necessary for success 
in education beyond high school.** Neither the literature, the advisory 

council, nor- consultants, were able* to define what constituted the 

•> ■ ■ 

requisite "skills and motivation** or how they were to be measured. 
The research team had considered administering standardized reading 
tests to obtain measures' on a basic skill that . is needed by persons of 
any ethnic background to acquire a postsecondary education in the 
United States. In addition, certain standardized aptitude and achieve- 
ment tests that were less culture-bound were considered as methods of 
measuring some skills that are generally considered helpful in acquiring 
postsecondary education. The advisory council strongly advised against . 
these considerations, pointing out that the use of any kind of test 
would gravely jeopardize the cooperation of the UB students in the 
vStudy and would cause some of the CS group to refuse to participate, 
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since both groups of students tend to fear and resent any kind of 
standardized test. Thus* the decision was made to exclude th^ adminis- 
tration of tests from the study. The study would, therefore, rely on 
obtaining from school records the school grades, course infontiations 
and test scores it would need to determine the changes that occurred 
over the years among the sample students # 

Another reason that the third major^UB objective was not desig- 
nated as a primary study goal 'was that time and ftmds were not ^avail- 
able for a longitudinal study (see subsection ZII.C. 2 above). One 
measure of whether the third objective was being fulfilled would have 
been to determine whether (with other relevant factors controlled) UB 
students^ in fact 6nter and complete postsecondary education at higher 
ratps than an appropriate comparison group^ (although this technique 
would have examined possession of "sufficient" rather than "necessary" 
skills and motivation) > Without a longitudinal study and investigation, 
of the third major objective, the study is." limited to examining some 
of the "Iiiimediate^^fffects" of Figure 1.1. 

Given time'^and budget limitations, it was-further decided that, 
among the various immediate effects the research should concentrate on~ 
the study of the impact of UB on UB students. Thus, the study of the 
possible effects of'UBon the peers and family of the UB students and 
on the high schools and postsecondary institutions, were given low 
priority. Although the final research design,- as presented in Chapter 2, 
did allow the study of other aspects of the UB process besides students,'' 
the study of the national impact of UB on its studentsj was set as a 
first pricyrity. This required national samples--of UB /'and' 'comparison 
students. ' ' ' *^ ; - - 

4 . Choice of Measurement Methods 

Because of the prohibitive cost of interviewing and other more 
direct methods of measurement for large numbers of subjects, written 
questionnaires were chosen as the primary instruments of data collec- 
tion* School records and other supplementary methods of data collec- 
tion were also used, as detailed in Chapter 2. 
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As an aid in obta'ining data of greater* depth and breadth than can 
be collected from the basic questionnaire approach, site visits were 
conducted at a subsample of UB projects. These site visits also 
served to familiarize members of the RTI research team with the day-, 
to-day operational aspects of UB in action* 

4 

IV. ORGANIZATION OF THIS VOLUME 

Although the procedures followed and aiialyses, performed during the 
course of this study constituted an integrated sequential process, the 
remainder of . this volume is organized into more or less discrete aspects of 
ttie study. Chapters 2 and 3 provide basic methodological considerations; 
Chapters 4, 5, and 6 describe the UB projects, staff, and students; and 
•Chapters 7 and 8 present the results of the evaluative analyses. The 
entiire study is summarized in Chapter 9. The information presented in 
subsequent chapters .can stand alone in some sense, but the integrated ^ 
nature of the analyses and procedures should be kept in mind. Different 
audiences will, of course, be interested in different .aspects of the study. 

outline is presented below to guide ^readers to appropriate phapters in 
ihich f.pecific topics are addressed. As an additional aid to the reader, 
tach subsequent chapter is concluded with a- summary of major points and/or 
findings, in addition to the final summary chapter. Some readers may find ^ 
It valuable to first r^ad chapter summaries as an overview of xhe material 
/presented in the chapter. The critical reader should, however, be fully 
/aware of the intricacies and^ limitations of the study design and data 
manipulations and of the basic analysis strategieg (Chapters 2 and 3) ^ 
before /proceeding to the r^nainder of the report 

With the exception of Chapters 3, 7, and 8, the presentation of ' 
results is relatively nontechnical. When specific analytic techniques are- 
mentipned, they -are brfefly described or explained either in the text or in 
a footnote, and professional references are cited. For the more technically 
minded reader, details are provided in a set of appendices which are bound 
separately for this volume and which are outlined below. 
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Chapter 2 presents a ralatively nontechnical detailed description of 
the final study design and methodology. The chapter contains descriptions 
of .(a) the ins-rtrn ^TiiT-rrt-j n'n ior the study, (b) the p)rocedures followed for • 
data collection" a:nci caxelima^Ty dats processing, (c) the development of 
date- bases. /or analysis, aad (d) techniques of data processing employed to 
prer .re the "data ±r)r analysis. ^ - 

Chapter 3 provides an rr7erv±eW of the analyses presented in subsequent 
chap-cers and a discussion ^oi limitations of the study, including a thorough 
anaiysis of dats quality. Hie analyses presented in this^ chapter are 
somawhat tefchni^ial bait sb-ouid presencVp difficulty for most readers. ^ 

.Chapter 4 pressms a: basic descriptive national prof ile^f the staff 
meicmers of UB pxoi^-^s (directors, counselors, and instruct^Srs) , including 
' thedx background (rhsrracteTistics, education and training experiences, 
edusiational philosc3::;aies, and perceptions of the program and its students. 
This profile i-s dervellDped from the questionnaire responses of staff, members , 
but is augment^, i::^ impressions that were gained during site visits. 
Res:uits are preHsznsji in nontechnical tabulate-form. ^ - 

Chapter 5 .cairi=iiiris a national description of the UB projects, including 
programmatic ch^n^^tHristics, advisory committees, costs, staffing patterns, 
and interactioirs bistween and among project staff, students, and community. . 
The descriptivra r^^lts presented in Chapter 5 are drawn primarily from 
' questionnaire :resc;mses but are supplemented by repcnrts from the project ^ 
site visits\ Mos:r results are reported in a nontechnical tabular 
presentation. ' 

Chapter 6 provides a different perspective of the national UB program, 
giving student: pexirsLpciorns of various aspects of the program. Student, 
questionnaire resBxinnses provide the basis for this description, although 
impressions of tie -ssponsas of .stucants to interview questions during site 
visits are used. rcD suipplement the questionnaire data. The presentation of 
these results lis montechnical and tabular. 

Chapter 7 trrsports the relationships between U3 participation and 
s:t:adent outcomes > T£ie presentation in Chapter 7 is somewhat technical, but 
should present fsss difficulties to the majority of readers. The*chapter 
iLrludes discussioiris of baseline differences between UB and CS groups and' 
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an analysis of tKe impact, of UB in terms of high 9chool retention and entry 
into postsecondary education, as well as other measures of student outcome 
which are theoretically related to success in postsecondary education. 

Chapter 8 contains an examination of the differential relative effec-- 
tive^ess of the UB projects sampled for this study. The chapter focuses on 
relationships between certain identifiable project characteristics (process 
dif feren.c*es) and student • outcomes (output dif f erence0 . The orientation of 
the' chapter is that 'of generating hypotheses concerning which, if any, 
project characteristics are associated with successful projects (as measured 
by student outcomes). Chapter 8^is quite technical and employs advanced 
multivariate approaches to analysis. 

Chapter 9 summarizes the major findings of the UB study and presents 
discussions of these findings and their implications fpr program policy. 

* The following appendices of supporting documents and technical infor- 
mation, for Volume .IV have been prepared and bound separately: 

Appendix A , Data Collection and Processing Procedures. 
' ■ Appendix B , Sampling Methodology and Sampling, Error Computation. 

Appendix C j Instrument Development. 

Appendix D , Instruments and Important Letters. 

Appendix E , Data Processing Procedures. 

Appendix F , Weighting ^and 'Standardization. 

Appendix G , Other Data Analysis Techniques. > 
Appendix K , List of Consultants and Advisory Council, Stiudent Panel, 
and Analysis Committee. Members. 
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Chapter 2 

The Study Design, Methodology, and Procedures ' . /. 

I./ INTRODUCTION ' . ' 

' Much^of the final study design was shaped by considerations outlined 
in -th'e, previous chapter. This chapter presents the final design and meth- 
odology, as well as the procedures followed in instrumientatioh, data collec- ' 
tion and processing,, and other preparation of deta for analysis* 

To obtain the data necessary to satisfy the study objectives and to 
obtain results that would contain little bias either for or against the 
program being ^evaluated, the study design involved the collection of data 
from many sources and from a broad spectrum of persons. Samples of UB 
project staff, UB students, and comparison students were- all surveyed by 
written; questionnaires. Data regarding students were also obtained from' 
high school and project records, and, because questionnaire responses and 
data of record can sometimes provide a superficial or misleading picture, 
site visits were made by the RTI team members to personally observe project 
operations and interview project personnel. / 

The three basic groups providing data, the timing of data collection, 
and primary purposes of the data obtained are summarized below to provide 
an overview of the study design. 

Students . In spring 1974, a sample of UB students and a sample of 
comparison students who had been enrolled in school at the beginning of 
the academic year (fall 1973) were administered questionnaires. One type 
-if questionnaire was administered to students in the schools and projects; 
another was mailed to studenJzs who had dropped out of the schools or projects. 
The primary purposes of these questionnaires were to determine whether the 
students .were still attending school and to obtain information about their 
background and other characteristics. 

During the same period (spring 1974), course gradiis and other academic 
information (from the ninth grade to present grade level) were obtained for 



sample students. These data were obtained from school and project records* 
The purpose of these data was to determine whether course grades or curri- 
culum changed after participation in UB. , ' 

In the fall of 1974, the same students were mailed short question- 
naires to determine their school status and grade level. Brief telephone 
interviews were subsequently conducted to obtain similar information from a 
sample of those who had failed to return these fall questionnaires. 

UB Project Staff . In spring 1974, questionnaires were mailed to a 
sample of the staff members of those projects from which the UB students 
had been selected. Specifically, questionnaires were directed to the. 
project directors, counselors, and , instructors of these projects, for, the 
purpose- of obtaining data about the characteristics of the staff members ' 
and of their projects. ' ' 

Site Visits . In the. spring and summer of 1974, 15 of the UB projects 
in the sample were visited (5 of the 15 were visited during both spring and 
summer, the remainder were visited only during the summer) . The visits 
were made to obtain firsthand insight into the academic year and summer 
components of UB projects, as well as to-^ validate some of the responses 
obtained in the returned UB staff questionnaires. 

Data were also collected from high school staff personnel in an 
effort to explore the feasibility and value of a future study of the 
impact of UB on high schools that send students to UB. Because ^'of low 
response rates to those questionnaires used in collecting data for^such 
analyses and because of the poor quality of data^ that were collected,, it 
was decided that results would not justify the expense of data processing ' 
and analysis. Therefore ^ the details of this smalrl feasibility substudy 
are not presented in the body of this report. However, since the original 
design did call for the collection of these data, the details of instrumen- 
tation, sampling procedures, and data collection for the substudy have been 
included along with those of the principal study in Appendices A, B, 
and C; the instruments are not, however, included in Appendix D. 
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. II. CONCEPTUAL, FRAMEWORK 

After the selection "^of the general approach, a process model was 
devised to guide the further development of the study design, and a synthetic 
cohort approach was adopted to help alleviate difficulties posed by the 
cross-sectional aspect of the design. These matters as well as the choice 
of the required comparison group are discussed in this section. 

A. Comparison Process Model . 

"A model depicting the specif icf details of the operation and effects of 
the UB program has been presented in Figure 1.1. T'.ie models to be described 
here represent more general models of processes. These models indicated 
the types of data that were to be collected, helped identify the sources 
from which the collection should be made, and thereby helped specify the 
study" design and guide the analysis. 

' Any proposed examination of. the UB program implies a study of a process. 
A simple model of the essential features of a process is depicted in Figure 
2.1. To analyze the process, data relating to the several, aspects of this 
model need to be obtained: 

1) Operational characteristics (i.e., the structure and functioning 
of the process) . ^ ^ ' 

2) Characteristics of input (i.e., the nature of the raw material on 
which the process operates) . 

"3) Characteristics of output (i.e., the nature of the designated 
product of the process) . ^ 

4) Characteristics of resources required for operation (i.e., the 
nature of that which is required to start the process and keep it 
in operation) . 

5) Byproduct characteristics (i.e., the nature of any riondesignated 
results of pfocess operation — over and above the designated 
output) . 

6) Relationships between various aspects of t'he system (i.e., any 
changes to characteristics of input as reflected in the charac- 
teristics of output; benefits of the process as reflected in 
desirable transformation of input into output and in desirable 
by-products; cost effectiveness, etc.). 
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Figure > 2.1. A Simple Process Model. 



For many physical processes that take place over a short period of 
time, this type of examination is quite sufficient. For social processes 
(especially educational intervention processes such as UB) , such examina- 
tions fall short in many respects, particularly in terms of definitively 
verifying the worth of the process. There are two major reasons for these 
shortcomings. First, these processes do not take place in a vacuum; rather, 
other processes operate on the input over the same period as, the process 
under study ^ Second, the processes are not stationary over time; that is, - 
the process itself is modified by external and internal forces. For these 
reasons, any desirable transformation of input into output 'or any desirable 
byproducts of a program such as UB could be attributable to other operating, 
processes or to an interact: '.on of the process under consideration with 
these external processes. As long as dhe is concerned only with descriptive 
characteristics of input, output, resources, byproducts, and operation at 
one point in time, the simple process model may be appropriat.e even for 
social processes. However, in examining relationships among the system 
elements, particularly in assessing worth or value of the process, or 
effects of process on input, the simple process model is typically 
insufficient. 
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To overcome these shortcomings in the evaluation of a process, the RTI 
research team adopted a process comparison model, which is depicted in 
Figure 2.2. Here one is concerned with a comparison of two (or more) 
processes operating within the same overall environment constituted by 
other ongoing processes. These two processes function within the context 
of other ongoing- processes (such as the high school educational system, 
community, and other social programs). Using such a process comparison 
model, a statement regarding the relative value of the two processes could 
be made in terms of the relative desirability of the two outputs (e.g., UB 
and non-UB school retention rates), relative cost effectiveness, relative 
desirability , of byproducts, etc. Such statements, however, could be 
misleading if there were notable differences in input to the two processes 
due to some, systematic selection mechanism. The validity of axvf istatement 
regarding rela^tive value based on differential output, byproducts, or 
resources reqaired, therefore assumes that (1) input to th:= ^jio pr'ocesses 
under considsration is similar on relevant dimensions, and all other 
relevant proi^sses operate more or less equivalently on both ^ts of input. 
This is i-iDlicit in the depiction in Figure 2.2. 

The first assumption concerning similar input 'requires that the 
comparison students be selected carefully, and that any systematic differ- 
ences in the input characteristics betiween the UB group and the comparison 
student (CS) .group be considered in analysis. The second assumption 
regarding the equivalence of other processes' operating on both inputs (UB 

and non-UB students) requi7:es that information about these other processes 

' 2/ 
be collected • for both groups and accounted for in the analysis.— 

The models presented are very simple ones compared to the UB program 

as it actually exists. The UB program is, in reality, but one of several 

interrelated processes of educational intervention, each of which is a 



— One of the processes may arbitrarily be considered as an absence of . 
the other process. Thus, UB could be considered as part of the processes, 
and the absence of UB (operating upon nonparticipating comparison students) 
as the other process. ^ ^ 

'2/ 

— The choice of the appropriate CS group is discussed in subsection II, C 
and statistical adjustments for differences in Chapter 7 and Appendix F, 
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Other Processes 
in Operation . 
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• Byproducts 



Resources 







Process 



2j> 







Byproducts 



Output 



Output 



* Process 2 may be conceptualized as no more than an absence of 
Process 1. 



Figure 2.2. A Simple Process Comparison Model . 
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subprocess of the largei: network of educational and/or social development." 
Additionally, there are distinct, related subprocesses within the UB - 
program and various feedback loops to adjust these subprocesses, as well as 
the main (UB) process, over time. The models are not, however, intended to 
depict precisely the intricate mechanisms of the UB program. Rather, 
the intent is to provide a conceptual framework for the study design and 
analysis. . As such, the simple models are helpful in specifying the various 
classes of relevant variables to be measured and analyzed. 

B • Eynrhetic Cohort Approach 

O, like most educational intervention programs, is a dynamic process 
which Xakes place over an ezctended period of time. The required data for 
analyHis include baseline Erasures on input, measutes of resources expended 
over time, measures Qf byproducts over time, measures of process structure 
and function over time, measures. of the input at various stages of process- 
ing, and measures of final outp.ut in terms of stated purposes of the UB 
process. Similar data are, of course, required from a "comparison" group 
of npn-UB participants to speak more definitively to t;he question of UB 
impact on the student. Such data may be collected either longitudinally or 
retrospectively. 

>The design used was basically cross-sectional; howeverj some retrospec- 
tive and short-range longitudinal data were gathered. Three reasons led to 
this choice: (1) the pitfalls of obtaining retrospective data and the 
limitations on the types of such data which are retrievable, (2) the costs 
inyolved in the more desirable longitudinal approach, and (3) the more 
immediate, concerns of government decisionmakers which precluded sole reli- 
ance on a longitudinal design (which would provide answers to crucial 
questions at a point too far removed into the future) . 

The cross-sectional approach poses a problem in that it examines a 
long-term process at a more or less frozen point in time. Various project 
participants at that point in time are not only from different age cohorts, 
but also at different stages of processing. The solution implemented for 
the current study is that of using a synthetic cohort, an approach that 
approximates total process action by examining the input and output at 
various stages of processing and putting together the various segments. to 

/ 
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present the total picture. An example of how this synthetic cohorx approach 
can be used to avoid some of the problems encountered in a strictly cross- 
sectional approach is presented below. 

Two of the ma^or objectives of the UB program with respect to its 
target population are to increase high school (HS) retention rates and to 
increase postsecondary education (PSE) entry rates. Some past evaluations' 
of the success of the program in attaining these objectives have examined 
whether UB participants in a specific senior class continue into postsecond- 
ary education at. greater rates than do other poverty-level students in that 
same senior class. Such designs are weak because they^do not control for 
the selectivity of the groups being compared. That is, they study compari- 
son students who have "survived" on their own in a school system through . 
which the UB participants have. been specifically assisted (i.e., to become 
seniors). Thus^ ttxese comparison students are basically different from the 
UB group even if the two groups were equated on other relevant factors 
(e.g., socioeconomic status, ethnicity , high school type). 

The synthetic cohort approach to the analysis of the UB process allows 

one to control. to some extent for this selectivity or "survivor" effect, 

within the time constraints of the study period. Control Is obtained by 

adopting a theoretical frame^>/ark. based on transition of individuals 

3/ 

through the various stages of the educational- process. A simplified- 
depiction of tfhi^ transition from- ten th^g^ completion of post- 
secondary study is given in Table 2.1. Such an Approach is Markovian in 
character (with implication of postsecondary graduation or dropout as 
absorbing states). The various p^ values given in Table 2.1 represent 
conditional probabilities (relative frequencies) for transition to a subse- 
quent (Stage, given attainment of a current stage . 

The characterization of.; the p^ values as conditional probabilities 
allows the direct computation of^ the probability of the completion of "the 
entire chain of steps. In a longitudinal study, such probability could be 

3^— — . ) 

— The model presented is simplified in that it does not allow for atypical 
movement through the process (e.g. , High School Equivalency programs, dropout 
and return, open door postsecondary ' institutions not requiring high school 
completion, etc.), but focuses on the typical progression. 
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Table 2.X 

SIMPLIFIED, TRANSITION MATRIX FOR PROGRESS THROUGH STAGES OF :EDUCATI(KI 
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condary 
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a/ ■ '^X ' '. ' 

— This transition probability could not be estimated within tfie -current 
study design. \ • 
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estimated directly from observing the students throughout the entire period. 
But in the case of a timebound study such as the present one, which is 
limited to an observation period of less than a. year, such direct estimation 
is not possible. To the extent, however, that the individual p^ values can 
be estimated in a timebound study, the proportion of interest (proportion 
completing poscsecondary education given tenth grade entry) could be esti-- 
mated by the nature of the transition matrix. The probability of completion 
of postsecondary education given tenth grade entry is simply the product of 
p- through Oq. Different p. values would, of course, have to be estimated 
from different student (grade level) cohorts, and. assumptions must be made 
that the' p^. values are relatively stable in time (and that the process is 
relatively stable) for the approach to be valid. That is, the assumption 
feust be made thrt the transition probability (or dropout rate) for a given 
gracie i^.g.,- eleventh grade) is the same over time. To the extent that 
such an asstimption is basically true, the timebound study can answer 
critical questions regarding a process which takes place over a^ considerably 
longer time than Che period available for observation.-- The transition 
mat\ix model can be applied to both UB participants and nonparticipants , 
and ckii be easily modified to take into account entry into the^UB program / 
at various points of educational attainment- 

The survivor or selectivity effect catf be examined within such a 
model. Fofv example, a finding of no difference in the values of p^ ^ 
through Po between UB" participants and nonparticipants would be considerably 
modified by a finding of considerably higher p^ through values for UB 
participants. In other words, should the survivor effect be influencing 
any differential probabilities of twelfth grade completion or entry into 
and completion of postsecondary education, this influence can be taken into 
consideration by showing that survival rates for UB participants from 
tenth to twelfth grade are substantially greater than for comparison^ students . 
More succinctly, high school graduation and subsequent education are dependent 
on having obtained the .twelfth grade level. 



4/ 

„^ Although the transition matrix begins by assuming tenth grade entry, 
it is considered adequate for purposes of this study since almost all UB 
intervention comes ^at or after such a point in time. ^ 
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In the present study, giv^n populations of current UB participants and 
nonpar ticipants, and an' ai/aiL^le period for data collection of April 
through December 1974, computation of some of the p^ values required 
retrospective data while computation of others required data collected over 
a short longitudinal span* Specifically, estimates of p^^, p^, and p^ were 
obtained from studying three groups of UB participants and three groups of 
nonparticipants wjao entered the tenth, eleventh, and twelfth grades respec- 
tively at the begini^ing of the 1973-74 academic year, with notation in 
spring 1974 of thpse remaining in school. Since the year was nearly 
finished, if they were still in schoolj^ it could be assumed they were 
likely to complete the school year. Confirmation of completion was obtained 
in the next point in data ^collection (fall 1974, when the same students 
were again contacted to determine whether or not they had progressed into 

• .. , ■ i • 

the next grade or into postsecondary education) • These additional data 
were necessary for estimating. P2, P^^, and p^. The values of and p g 
of Table 2.1 could not be estimated within the current study design . The 
specific cohorts from which each of the estimated values of p. WQ(^e to be 
obtained and the times of data, collection are summarized in Table 2.2. - 

C. Comparison Students 

V The design of the study called for studying, a CS group. Thus a / 
•comparison population was defined and sampled. In defining the comparison 
population, the goal was to identify a, group as similar to the UB students 
as practicable^ limiting dif f erences . to their rionparticipation in UB. For y 
the approach adopted in the study, students in the same grades as the UB 
sample were selected. Because different schools influence the school 
continuation rate and 'other outcomes for thedr students, it was also con- 
sidered desirable to define the comparison ^roup as students attending the 
same schools as the UB sample. Finally, comparison students within each 
school were" selected to be similar to UB students on the basis of low 
income and ''academic risk** status (see below subsection IV. A for procedures 
followed in selecting the CS sample) . ^ 

The choice of such a group presented two difficulties. First, Ito the 
extent that UB activity in a school has had a beneficial effect on students 
who have not directly particit^ated in the UB program, the study results 
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table 2.2- 

STUDENT COHORTS, POINTS OF DATA COLLECTION, AN 
ESTIMATES OF PROPORTIONS CONTINUING EDUCATION 
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Time 
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Progression 
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— ■ Data obtained retrospectively (records show students to have been in 
school in fall 1973). • 

K 

h/ / 
First data collection period. 

— Second data collection period (followup).. 
E = Upward Bound, participants. 
C Nonpar ticipants. 
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would be biased toward underestimating beneficial effects of the UB program. 

Second, the comparison students from the same schools could represent 

students' who theoretically could have participated in UB but for some 

reason did not choose to or were not selected by UB. In this basic manner, 

• they would differ, from the UB sample. The indirect or peer effects of UB 

.on 'non— UB fellow studsnta were considered to be relatively small because in 

general only ^ few strudsnis from any one school participate in UB and 

usually the participa-tioni effects no basic changes in the treatment of low- 

■ • . \ ' • ' . ' ' " ■ ■ . ' ' 

income, students by -the. srhools, Thfe selection Ijias was not eliminated," but 

to some extent it was coaccrolled ' by examining cfflRWftSwdristics of selected 

UB and cpmparison students suph as socioeconomic status, school grades and 

course 6^^ study prior to UB participation. By statistically adjusting for. 

such differences, bias introduced by the selection problem is reduced.—' 

\ • ■ ■• ' • i ■ . • 

The t^d difficulties were judged as relatively minor, however, when 

compared to" the problems- presented by alternative definitions jof the CS 

gxoup. An alternative .definition of the CS group that could t'ake into 

account th'e peer effects would be students in the same grades as the UB 

sample but from schools not involved with UB. The problem presented by 

this definition is that such students are likely to have experienced very 

diff^erent school influences than the UB students. These school effects 

were consijdered to be of much greater' magnitude than the peer and selection 

effects inherent in the other, definition. The use of both comparison 

groups was considered desirable.^ but the expense of such an approach was 

prohibitive. 



III. STUDY OBJECTIVES ' 

.... / 

■,■/'■ - 

Tfhe adopted process model specified the data to be collected for 
determining whether tii^ UB program is increasing the rates of retention in •■ 
high school and eatry into postbecondary education (the two primary study 
objectives). In addition, the data specified by the process model were' 
used to analyze other questions, which were of interest either because they 

37 ' ■ '■ ' . 

— Although selection occurs and hence introduces possible bias, ..usually" 
an UB project is able to accept into the program only a small fraction of 
all students who apply or stand to benefit, leaving a large pool of students 
who are similar to the UB participants. 
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would ai^* in the interpretation of the results of the two primary ques- 
tions-, or because they held programmatic interest to USOE, or both. These 
.other questions, however, took a lower priority, secondary to the goal of 
providing accurate answers to the two primary questions. The various 
analysis questions can be organized into three general study objectives: 



"to" desc^^ program as it exists *^at 

present (this includes a description of the characteristics of 
staff and students, their perceptions of the program, project 
operations and costs) . 

b) To investigate the effects of UB participation on students (ttiis 
includes not only rates of high school retention and postsecond- 
ary entry, but changes in high school academic measures such as 
grade point average, preparation of courses that were "academic," 
etc. ) . 

c) To compare the relative effectiveness of various types of UB 
projects in producing these effects (projects grouped by such 
variables as sponsorship, size, and^ primary project emphasis). 

^ IV. SAMPLING PROCEDURES 

The study design required that a variety of samples (e.g., of proj- 
ects, schools, students, project staff) be taken. In all cases, proba- 
bility sampling techniques were employed.—^ This allows unbiased estimates 
tb be made from the sample data, and estimates of sampling errors to be 
ca5j.culated.-^^ 



— ^ In a probability sample, only some members from the entire study 
population are selected with a known probability of selection. 

— ^' Because one is measuring only a sample of elements rather than ell 
elements in a population, one can only estimate population values. If, for 
example, one wished to know the number of dropouts for the population of UB 
tenth graders, one could estimate this from sample data. When probability 
sampling is used, it is possible tq compute estimates that are ■ unbiased . 
The statistical meaning of the term "unbiased" is that the expected value 
of the estimate has the same value as the population value one is ^estimating 
That, ts, the average yalue of the estimates for all possible samples would 
.be equal to the population value. The actual value of the estima-te would, 
of course, vary from sample to sample, and the standard deviation of the 
estimate is termed the sampling error (or standard error) of- the estimate. 
The magnitude of the sampling error is related to two things over which the 
sampler can exert, some control, namely, the size of the sample and the 
procedures used in selecting the sample. 

^ ■ ^' 
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Specific sampling procedures and considerations ahi the implications 
of these procedures for statistical examination are presented in Appendix B. 
Only a suimnary of the samples chosen are given in this subsection. Gener- 
ally, in determining sample^ sizes, some estimates were made of the charac- 
teristics of the population, the size of the sampling errors that would be- - 

obtained from different size samples, and the cost of conducting various 
phases of the study. 

A. Student Samples 

To select the sample of UB students, a two-stage sample design was 
employed. In the first stage, a sample of UB projects was chosen. Weighing 
the required precision of the estimates to be made from the samples together 
with other operational considerations, it was decided to select 54 of the"^ 
333 UB projects into the sample. In the second stage, from each sample 
project, all UB students who were tenth, eleventh, or twelfth graders were 
selected, a -total of 3j747 UB students. 

To select the sample of comparison students, using the previously 
stated definition of the CS group, a^ multistage sample design was imple- 
mented. For each of the 54 UB projects selected into the sample, two 

• \ 8/ 
"feeder" schools (those sending students to these projects) were selected.— 

From each sample feeder schoqj., a sample of six classrooms (typically two 
from each grade level 10, 11, 12) was selected. From the selected class- 
rooms,, a sample of students was then selected, averaging about 22 students 

per school, and yielding a total of 2,401 comparison students dn the sample. 

\ 

In order to \select students who were likely to be similar to UB ' 

\ ! . - ■ - 

students from the\ sampled classrooms, information was obtained from class- 
room teachers regaiiding /the grade level, ethnicity, low income status^ and 
"academic risk" status of each student iu the class. These variables were 
used to stratify the sample, and a higher proportion of student? was selected 
from the group .tenta.tively classified to be^more like U'B students (i.e., 
low-income and academic risk) . This scheme allowed choosing more students 



— In the final sample an average of two feeder schools per UB project 
was obtained but in several cases more or less than two feeder schools 
per project were u|;ed. 

,j ■ • 56- 
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who were likely to be similar to- UB in these important respects.— The 
successive stages of selection of the UB and comparison students are^summa- 
fi2ed in Figure 2.3. 

Afjter the spring 1974 administration of questionnaires, the same 
studentl^ were asked to participate in a followup in fall 1974 (see Section 
VLB. 5)'. Some students failed to respond to the spring questionnaires, and 
some, to the fall questionnaires. After the fall followup questionnaires 
were returned, samples of nonrespondents to prior instruments were selected 
for telephone followup in late fall 1974. About one-half of all students 
who did not respond to the fall mailings but who had answered one of the 
spring questionnaires were chosen. All persons who failed to respond to 
both the fall and spring questionnaires were selected (excepting persons 
previously refusing to participate in the study or misclassif ied during the 
original sample selection) . 

B. Samples of UB Project Staff 

For each of the 54 UB projects selected into the sample, several staff 
members were selected for the questionnaire survey. In each project, the 
Project Director, and a sample of counselors and instructors who worked 
full-time or part-time during the academic year or summer sessions, were 
selected from the staff. In general, six staff members per project with 
proportional representation of counselors and instructors were chosen. In 
this way, 54 project directors, 104 couns^elors, and 211 instructors were 
selected. 

' \ 

C. Site Visitation Samples \^ 

Of the 54 sample UB projects, 15 were subsamptled for site visitation. 
Using stratified probability sampling procedures, thja^lS projects were 
selected to include at least one project from each o£ the 10 USOE geographic 



— ^ The preliminary judgment by the teachers about the characteristics of 
the students were used only as an aid to sampling; the ultimate determina- 
tion of whether the selected comparison students were similar was maSe, 
■during analysis on the basis of their own reports and school or projectX 
records. Differences between the UB and comparison students were statis- 
tically adjusted in analysis as explained in Chapter 7 and Appendix F. 
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regions, and to be representative of " the population with respect to partici- 
pant ethnic composition and ■ location (i.e., whether they are from large 
city urban areas, other urban areas or rural areas). In addition, 3 of the 
15 projects had strong academic programs which functioned during, the school 
year as well as during the summer, and 2 had an associated Talent Search 
project. 

After the subsample of 15 projects had been selected for site visit- 
ation, 5 of the 15 '.re designated to receive 2 site visits, one during the 
academic year and one during the summer. The .remaining 10 projects received 
a single site visit during the summer. The three. projects in the sample 
having strong academic year programs were designated with certainty to 
receive two site visits. Of the ;i:emaining 12 projects, 2 were randomly 
designated to receive two site visits, each of the 12 having been given the 
sau-e chance of being designated.- 

. . ^ 
V. INSTRUMENTATION . ' 

The study design called for the development of a large number of data 
collection instruments. This section provides a brief description of the 
instrumentation. A more detailed description of the development process 
and th^ iastruments is given in Appendix C, while Appendix D contains 
copies of all the instrument^. 

A. Instrumei?.t Development 

The study design required the ^ development of a large number of instru- 
ments to collect daCa from many sources and from a wide range of persons. 
The process of instrument development began in early August 1973 and contin- 
ued through January 1974. The stages of instrument development included: 
(1) specifying data elements required by the ^study objectives; (2) determin- 
ing the types of individuals and other .sources\ from which to gather the 
specified data; (3) drafting and revising the specifications for each 
instrximent; (4) assembling instruments from Telaoted studies' to serve as 
item pools; (5) drafting preliminary versions of each instrument.; (6) 
presenting the instruments for review and revision by the Advisory Council 
and Student Panel; (7) performing limited pretests and subsequent revisions 
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and (8) submit: ting the instruments to USOE and Office of Managemefit and 
Budget (0MB) for approval (with two subsequent minor ref in'ements) . 

A wide variety of groups 'and individuals provided valuable and critical 
input to the development of instruments at each of the above stages. The 
list of contributors includes the study Advisory Ccuucil, the Student 
Advisory Panel on Instrumentation, local project and high school staff 
members, and various consultants with expertise in related fields. Appen- 
dix H provides rosters of committee members. 

When final specifications were available, a potential item pool was 
formed by assembling instrumeqts used in other studies in related areas ."^ 
This pool included instruments used by Hunt and Hardt— ^ in their evalu- 
ation of Upward Bound, instruments used by Educational Testing Service in 
the evaluation of the Special Services program,-^^ instruments which were 

being developed at RTI for the first followup of the National-Longitudinal 

' 12/ ' " ^ 

Study of the High School Class of 1972, — and several instruments used by 

> 

UB projects' in- self -evaluation (see Volume I of this report).* Given the 
paucity of studies of this nature on Upward Bound, many of the major subject 
areas to be covered in the instruments were previously unexplored. In 
these areas, new items were written.* The process of selecting items and 
drafting preliminary versions of each questionnaire continued through 
November and early Dej^ember, 1973. 

After formal reviews of the drafted instruments by the Student Advisory.' 
Panel on Instrumentation and by the Advisory Council, and after limited 
prktests and internal re,yiew by RTI personnel, the major instruments, along 
with a supporting statement, were first submitted for OE/OMB approval on 
25 January 1974. After two sets of suggested revisions had been made, the 



10/ ' 

— David Hunt and Robert Hardt. Characterization of Upward Bound: 

1967-1968.- Syracuse, New York: Syracuse Youth Development Center, 
August 1968. 

— ^ Junius A. Davis, G. J. Burkheimer, and Anne Borders-Patterson. > 
The Impact of Special Services Programs in Higher Education for "Disad- 
vantaged Students." ETS Project Report 75-14. Princeton, New Jersey: 
Educational Testing Services, 1975. 

12/ ... 

— USOE Contract No. OEC-0-73-6666 , Administered by the' National Center 
for Education Statistics, Office of the Assistant Secretary for Education. 
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package was resubmitted on 18 March 1974. 0MB approval of the major 

.13/ 
instruments was received or* 3 April 1974. 

B. The Instruments 

Data were collected through questionnaire responses, intervi^e^w respo^- 

ses, and student records. Most of the instruments used in this study were 
written questionniares. The Basic Student Questionnaire was administered 
by RTl study administrators to groups of respondents. For other instruments 
this was not feasible and questionnaires were mailed to respondents to be 
self-adn^inistered. Although the sometimes superficial nature of the ques- 
tionnaire responses and objective data of record constitutes a drawback to 
this form of measurement, it was felt that the interviews^ and observations 
made during the 15 site visits would provide the necessary depth of under- 
standing of the questi.vnnai . data. 

Since considerable reference will be made subsequently to the various 
questionn^vires, acronyms will be used throughout the remainder of this 
volume. A single listing of the instruments and their 'acronyms is given in 
Table 2.3 for convenient reference by the reader. The specific instruments 
and designated respondents, are also outlined below/ 

1, High School Classroom Student Identification R oster (HSCR) 

The HSCR was completed by selected classroom teachers as part of 
the plan for sampling comparison students in the Sample of 108 feeder 
high schools. Data ^provided by the classroom teacher were: (a) a 
listing of ail students in their classrooms in October 1973; and (b) 
for each student, his grade level, his ethnic classification, an 
indicationNrf^is academic risk status, and an indication of his ^ow 
income status. This data source was available for all students in the , 
comparison sample and was used to yield classifications of such students 
if the information was not provided by the students in one of the 
questionnaires. (No' comparable data source was . available for the UB 
f> students.) , 

— ^ Two simple instruments, the High Sch ool Cla ssroom Identification Roster 
and the Project Roster Verification Form » were used to collect information 
for sampling in fall 1973 and were submitted for OK/OMB clearance in early 
fall 1973. 
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Table 2.3 



BASIC INSTRUMENTS USED IN THE UPWARD BOUND 
EVALUATION AND THEIR ACRONYMS 









Acronym 


Instrument 


Use of , Instrument . 














BSQ 


Basic Student Questionnaire 


Collect information in spring 1974 
from CS and UB students who were in 
HS . ' 


D/TQ 


Student Dropout/Transfer 
Questionnaire 


. Collect information from CS and UB 
students who had left HS or project 
Dy spring j.y / h m 


FSQ 


Fall Statu-s Questionnaire 


Collect information in f^ll 1974 from 
Lb and uD SLUuencs • 


HSCR 


High School Classroom Stu- 


Collect information in. fall 1973 on 
trie Lo group rrom no classroom 
teachers,. 


PCQ 


Unward Round Proiect 
Counselor Questionnaire 


pz-iH 1 or* t" 1 Tl "Fm^m;? f" 1 OT) ■? n c-nT-nnrr 1 Q7 A 
^^WXXCtv L. A.l,kl.\J 1. Uixx L.XVJH Xli oPH^l^ ^ ' ^ 

from UB counselors. 


PDQ 


Upward Boxind Project 
Director Questionnaire 


Collect information in spring 1974 
from UB project directors. 


PIQ 


Upwaxd Bound Project 
Instructor Questionnaire 


Collect information in spring 1974 
from UB instructors. 


PRV 


Proiprf" "Ro<3tPT VpTificati nn 

Form 


Prill or* t- ■? rj "FnT"TTi;5 t" ■? r»-n -f-r* fn'Wl 107*^ r^-n 

ouiicCL xiii. iji. luci LXij^i m rail 17/0 on 
UB participants from project staff. 


SARF 


Survey Administrator Roster 


Collect information in spring 1974 
aoouL une l»o anu uii students oy une 
RTI Survey Administrators during 
BSQ administration. 


STF 


High School Transcript Form 


College HS transcript information 
in spring 1974; completed by ',RTI 
Survey Administrators*. 


SVR 


Upward Bound Site Visit 
Reports 


Collect information in spring land 
summer of 1974 on all aspects \of 
project operation during site yisits. 









NOTE: The instruments are listed alphabetically by instrument. 
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2. Ba sic Student Questionnaire (BSQ, Forms A and B) 

The BSQ was administered, in spring 1974, -to students partici- 
pating in UB and to a comparison group of nonparticipating high 
school ^students who were in the selected project feeder schools. 
Form A of this instrinnent , admitiistered to the CS group ^ includes 51 
items, and calls for over 200 possible responses. Form B, administered 
to UB participants, includes all the items in Form A plus a section 
specific to the UB program for a total of 67 items with over 320 
possible responses. This questionnaire gathered information on pre- 
process measures (student background and previous experiences) and 
outcome measures (e.g., aspirations, educational plans and achievements, 
and self concept) . It should be noted that these instruments were 
administered to only a subset of the entire student sample (specifi- 
cally, those comparison students still in the same^ high school in 
spring 1974, and those UB participants still in the same project in 
spring 1974), ^ 

3. Student Dropout/Transfer Questionnaire (P/TQ, Forms A, B, 

and C) . . 

The D/TQ was mailed to: (a) students ^in the CS group who dropped 
out, graduated, or transferred from the selected feeder schools between 
fall 1973 and spring 1974 (Form A); (b) UB participants who had left 
the UB pT^ogram and/or high school during the s^e time period (Form 
B) ; and (c) UB students who were still in the program at time. of.. BSQ 
■ administration but who were absent from the primary or makeup admini*- 
strations (Form C) .-^^ Forms B and C (for UB participants) differ 
from Form A (for the CS group) only in containing items which are 
specific to the UB program. Forpis B and C differ iu only one item^ 
Form includes 12 items with over 30 possible responses; Form B 
includes 19 items with 48 possible responses; and Form C includes 19 
items with 49 possible responses. These instruments were designed to 



— This use of &ie D/TQ was not anticipated during the design of the 
study, but due to low response rates from UB students (see Chapter 3) it 
was used as a convenient vehicle for obtaining some critical data from 
this group of students- 
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ascertain the dropout rate (as distinguished from transfer rate) 
during the school year for UB and comparison students; reasons for 
these dropout;s; and, for UB students, reasons for leaving the program. 
The specific subgroups of students completing this questionnaire are ^ 
obviously not '^typical" of the UB or CS groups. 

4. Hi^h School Transcript Fom (STF^ Forms A and B) 

Tlie STF was used by the istudy administrators in gathering infor- 

mation fir.o^ high school transcripts of sample students. Information 

from this form relates to the student's ac-idemic record over time. 

Form A was -used to obtain data for the CS group from school records. 

Form B was used to obtain similar data for UB students from UB project 

15/ 

files. Only minor differences exist between the two forms. — 

5. Fall Status Questionnaire (FSQ, Forms UBA, UBB» X:SA, and CSB) 
These instruments were used in two modes of data collection — as 

mail survey instruments and as telephone survey instruments. Initially, 

these questionnaires were mailed in fa.ll 1974 to UB participants' and 

comparison students selected for the study, to determine their educa- 

16/ 

tional status at that time. — - At a later time, a telephone survey of 
a large proportion of- FSQ nonrespondents was conducted, using questions 
from the mail version of the FSQ (altered only slightly to make them 
appropriate for telephone query). The "B" forms (CSB and UBB) of this 
instrument were addressed to previous non-respondents while the 
"A" forms (CSA and UBA) of the instrument were addressed to previous 
respondents. The ''B*' forms thus contain additional iquestions and 
represent a last attempt to obtain certain critical information from 
the student. Differences between UB forms and CS forms exist primarily 
in two questions relatiiig to length of UB participation. Form UBA 



15/ 



The transcript information was theoretically available for all stu- 
dents in the sample, however, in the cases > of dropouts or transfers, 
records had sometimes been forwarded or destroyed, and were therefore not 
available. Furthermore, the recordkeeping of UB projects was sometimes 
insufficient to provide the required information. 

16 / ' 

— Students who had previously refused, to participate or for whom no 
tracing information had been previously obtainei were not included in 
the mailing, ' 

— ^ Those who had not responded to any questionnaire during the spring 
1974 administrations. 
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contains fJ items and calls for up to 19 responses; Form CSA consists 
of 7 items and calls for up to 17 responses; Form CSB consists of 13 
items with 24 possible responses; and Form UBB contains 14 items with 
26 possible responses, , ^ ■ 

6 . Survey A dminisCrS^r Ro ster Form (SARF) 

Another source of student data was the record kept by the study 
administrator during administrations of the BSQ (either at the project 
for the UB group or at feeder high schools for the CS group) . Study 
administrators were directed to note the reasons why various students 
in the sample were unavailable for questionnaire administration or 
makeup sessions, TheVecprded information was obtaine:d from high 
school personnel in the c^s^ of the CS group and from project personnel 
in the case of the UB group, and provides a supplemental classification 
of studeiAt's activity st^te in spring 1974 (i.e., school dropout, 
project dropout) for a substantial number of questionnaire non- 
respondents. 5 

7 • Pro^^ect Ros ter Verification (PRV)_ \ 
A final source of UB student data is the PRV. The USOE m^.iled a 
listing of its most recent project roster to each project director of 5^ 
sampled projects for verification of project membership in fall 1973. 
Project directors specified the grade level; of verified participants; 
thus these data were available for all UB students at projects from 
which the PRV was rjeceived. , - 

8 , Upward Bound Project Director Questionnaire (PDQ) 

The PDQ was mailed in spring 1974 to the project directprs of all 
54 UB projects in the sample. The questionnaire was designed to 
gather descriptive iuformation onr the project director's background, 
experience, knd attitudes and on the project's expenditures, staffing, 
goals, emphasis, content, and strategies. The questionnaire contains 
42 items with, over 550 possilple responses.' 

9. Upward Bound Pro - ject Counselor Questionnaire (PCQ) 

The PCQ was mailed in spring 1974 to selected counselors at each^ 
UB project in the sample. The questionnaire solicited information 
related to characteristics of the counseling staff and of the counseling 
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function of the project. The ques^.i^^^^i^e contains 35 items with 
over 200 possible responses. 

10. Upward Bound Project Instructor Questionnaire (PIQ) 

The PIQ was mailed to selected instructors at each UB project in 
the sample in spring 1974. The information gathered is similar to 



that described above for other UB staff questionnaires excep.t that the 
emphasis is on instructor characteristics and "the teaching f miction of 
the UB project. The questionnaire contains 40 items with over 290 
possible responses. 

11. Upward Bo und Site V isit Report (SVR). 

. . 

These reports, based upon site visits to a subsample of 15 UB " 
projects, document and summarize the impressions which were gained 
through observation and unstructured interviews with UB students, 
project directors, project counselors and instructors, chairpersons of 
one or more of the'^UB Advisory Committees, and institutional representa 
tives (officials responsible for the projects at the host institutions) 

C * Glasses of Variables 

The kinds of ddta to be collected by the instruments descr5>bed above 

were specif ievl by the process comparison model (Figure 2.2). The classes 

of variables collected for study will be documented below in te Ans of this 

same model. There are many alternate methods of classifying variables, 

e.g,, student variables, project variables, etc. — or criterion (dependent), 

predictor (independent), or cidjustment (covariate, par tiallii^g , moderator) 

variables. It is felt, 'ovever, that the classification witftin the systems 

approach provides a more meaningful and irttegrated view of the data, consis- 

18 

tent with the overall instrumentation and analysis plan, — ( 

f * * ^ . ■ 

\^ For the purposes of presenting the classes of variables , the process 

modei^is modified-as shown . in Figure 2.4. The model has been expanded to 

reflect the fact that there are various stages of input processing, each 



18/ ' ' ' 

— Although the classes of variables developed are stated in terms of 
UB participants, it should be realized that in most cases analogous data 
were collected for comparison students who had not participated in UB. 
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Past UB 
Participants 



Figure 2.4. Simplified Process Model of Upward Bound. 
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with^ intermediate output Cwhich, in turn, 'is the input to the next staga of 

processing). The analysis, using the synthetic cohort approach, makes use 

of this aspect of the model by examining participants at various stages of 
l^A 

processing. — The model as presented in Figure^ 2,4 provides the conceptual 

framework which defines the essential classes of variables for analysis. 

These variable classes are described below and in greater detail in Appendix C. 

At/tempts were made to measure the specific variables listed, but for 
practical reasons (given In Appendix C) nb't all instruments coul4 measure 
all 'variabiles; thus measure were not- available for all studencl^on all 
variables. 

1. Pre-UB Process Data . Within this class of variables fall those 
attributes of UB participants (a) prior to their entry into the program 
(or at analogous points of educational development for CS students), 

or (b) which are relatively permanent and basically unaf f ecced by the 
ope^jation of the UB process. 

2. External Process Data . This class of variables concerns others 
rele-Jrant processes besides UB which may be operatingson the individual 
during the period of UB processing (or at analogous points of educa- 

-^tional development* for CS students)*. Of major interest here were (a) 

the existence and nature of such processes and (b) tiie extent of . 

20/ 

procef;sing which the individual had experienced. — 

3. Re source Data . This class of variables relateii to resources used 
in project operat?*.on. Included are (a) all'- financial resourqec 



19/ • 

— The model may be easily expanded to a process comparison framework — 
either for purposes of comparing differential relationships by types of 

UB projects (processes differing in structure or function) or for purposes 
of comparing correlateis of UB participation against nonparticipation. 

20/ ' ' 

— ^ The major concern for the present'set of data is the existence, nature , 
and extent of the operation of the external process as related to individuals . 
Attributes of relevant processes that may be operating on the structure and 
functioning of the UB programs were also considered in this study. But the 
conceicn in this latter case was not the individual student but rather the 
interaction of such processes with the UB process 'and the extent of this 
interaction. While such interaction data coiild be included here, they, will 
be considered below under the class of data relat^ing to program operation; 
i.e., such external processes in relation to the project will be considered 
as a par;t of the structure and function of the process. 
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(federal, private, institutional) of the project, (b) individual human 

21/ 

resources (from the community, the host institution, etc.), — - and 

(q) agency resources (host institution, :^eeder high schools, community) 

f^xpended on behalf of the program. The major concern is again with 

the nature and extent of the various types of resources. ' ' - , 

4,''. Byproduct Data . This class ^ variables relates to the possible 

effects of program operation on others besides UB participants, the 

r broad spectrum of phenomena commonly labeled "program impact." Impact 

can be either positive or negative, but is typically considered as 

change which has been brought about (within external processes, as a 

result of program operation) in \he attitudes toward, or functional 

^treatment of, disadvantaged youth (e. g. , families of participants, / 

22/ / 

communities , host institutions',, and high schools). — 
5* UB Operational Data . This class of variables concerns the 
. structure and function of the UB. program. ; As mentioned previously, 
paid UB staff and the impacts of external processes on the program, 
per se, are subsumed under this, class of variables. Also considered 
here is an evaluation of the structure ^md function of UB by project 
staff and student participants. Some. of these data therefore reflect 
both objective and subjective information regarding, program operational 
data. / / . " 

6. Prior UB Processing Data . This class of data concerns the 

nature and extent of prior processing of the individual student . 

i ■ ■ - ' •'* 

participants in the UB program. Specifically the type and length of 

exposure of prior program participation as well as any historical 



21/ , 

— With respect to the second category of resources, regular project 
staff, were not coi^sidered as resources, but rather as part of the struc- 
ture of the process. ; 

22/ ' 

— Specific attributes . related to these processes (as relevant to this 
data class) are the nature and extent of change experienced within such 
processes. It should be noted that there is a considerable interrelation- 
ship between this class of variables and categories (b) and (c) under 
Resource Data above (e.g., one valuable byproduct may be increased -^insti- 
tional resources offered to project). 
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pattern of interruption of program participation are considered,/ 

i 23/ / ■ 

including th^e^ current project year. — • 

7. Intei/me^diate Outcome- Data . Here, intermediate objectives ^of the- 
program, as measured by student outcomes, are considered. The/ outcomes 
ma}^ be instr|Umentar to the achievement of major outcomes, or be of 
specific insjtrinsic vs^-ue, or. both.' These outcome variables /thus- 
relate' to pojssible program outcomes othier than the three maVor objec- 
tives (e.g.,j measures such as grades, educational aspirations, etc. — 
where possible, stated relative to the preprocess measures' of tKese 
variables) . / / 

8. Major Outcome Data . These data are concerned with the three 
major objectives of UB as previoisly defined (i.e., increasing second- 

ary education completion rate of' the target population,/ increasing 

/ 

enrollment tiates in postsecondary institutions, and generating the 
skills and motivation necessary for success in postsecondary 



education) 



24/ 



VI. DATA COLLECTION 
MANUAL PROCES 



RECEIPT CONTROL, AND 
SING PROCEDURES 



and schedule of data ::ollection ca 



/ 



The introductory section to tiis chapter outlined tyhe primary sources 



ried out in the study. The procedures 



followed in colle^cting the data are^ summarized below and are detailed in 
Appendix A. 



23/ 

— It should be 1 noted that for the N3S group these data are inapplicable; 
thus these data were collected for UB\participants only. Data relevant to 
isubjective evaluation of these processes on the part ^pf the student, parti- 
cipant were also collected. Tlaere is an obvious ovei^'lap and relationship' 
Detween this subjective data and that tcj) be collected under^.UB operational 
'lata.. I 

~- The c^^ata which speak directly to th^first two /objectives are the 
estimates of transaction probabilities outlined in subsection II. B above. 
Data relevant to tHe third objective were \ob tained primarily from the 
variables classifieji under Intermediate Outcomes abbve (e.g., specific 
skills and motivational increases which are commonly seen as related to 



postsecondary success, such as that derivable fromjhigh school course 
information). 
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A. \ Preliminary Activities 

^uring the end of the planning phase of the ^study, mall and telephone 
contacts (and in some cases visits) were made with UB and high school 
personnel to inform them of' the study, to obtain cooperation, to collect 
data required for sampling students and stai"/", Bn<^ ^ in the case of schools, 
to establish liaison persons for future contacts* In the. case of the UB 
projects, the persons contacted were t^e project directors; in the case of 
high schools, the principals were contacted, after the endorsement of 
officials at the state and district levels had been obtained. Subsequently, 
a liaison person at each feeder school was contacted to obtain information 
required for- sampling comparison students and for arranging questionnaire 
administrations. 

RTI survey staff visited study sites to plan the administration of the 
BSQ with the schools and projects, and to recruit, interview, and hire 
local study administrators. In 6 regional one-day training sessions held 
during April 1974, 64 study administrators were trained in the' procedures 
required for administering the BSQ to students at the selected UB projects 
an^ schools and for collecting transcript i-nformation from project and 
school records. 

B. Student Data • 

■ - - — - ■ _ ■ ^ 

The* steps involved in the complex flow of student data collection are 
summarized in Figures 2.5 and 2.6. Specific procedures are summarized below. 

1. Administration of the BSQ 

Administrations of the BSQ to groups bf UB students were conducted 
during regularly scheduled meetings at the project sites. For projects 
that were "not able to assemble sizeable proportions of their students 
on site, administrations were'held for*smallei: groups at the high 
schools attended by the sample students. For ..projects in which less 
.than 80 percent of the eligible students appeared at the originally 

25/ 

scheduled administrations, one or more makeup, sessions were conducted. — 
These procedures were implemented in April and May 1974. Because the 
response fate was lower than expected after these efforts, additional 



25/ ' 

— For two projects with low response rates after the makeup sessions, 
BSQ questionnaires were mailed to the students. 
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adminiGtrations of the BSQ to previously absent UB studt.uts were 
conducted during the summer UB program (in June and July 1974). 

The BSQ was also administered to groups of comparison students at 
their schools during spring 1974.:. Makeup sessions were conducted 
where less than 85 percent of the potential respondents appeared for 
the original administration. / 

2. Collection of SARF Data , 

During the BSQ administrations at both the projects and schools,, 
the study administrators obtained from project or school personnel the 
'/reasons for. tlie /absence of sa:^ple students and recorded these on the 
SARF. By this ipeans, UB students who hr.d left the selected projects, 
and comparison students who had dropped out or transferred from the 
selected schools, were identified. These students were thus identified 
to be the recipients^ Of the mailed D/TQ (see subsection VLB. 4 below). 

3. Collection of Transcript Information (STF) 

During -the weeks of BSQ administration, the study administrators 

gathered transcript data on all sample UB students from records kept 

in UB project files. These transcript data were recorded on the 
26/ 

STF. — Also recorded on this form was the current address of the 
student (it knoxm) and two names and addresses of persons through whom 
the student could be reached. The transcript information for the 
•sample CS group was obtained primarily from school files, and sometimes 
also from city and disti J:t school offices. 

4. MailL . o: of the D/TQ 

The entire package of BSQ, STF, and SARF were returned to RTI 
after completion of this data collection effort. The SARF identified 
the afjpropriate. target students for the D/TQ, while- the STF provided 
their addresses. As soon as these forms were received by Rll, the D/TQ 
was mailed to those identified to have left their project or school. 



2G/ ' " 

— Because project files were not uniform in organization and amount of 

data recorded, the administrators expended c .^nsiderahle effort, with the 
aid of project personnel, in tracking down the desired information from 
schools and from a variety of project records. In addition, the study ad- 
ministrators required the aid of school and project . of ficials in decipher- 
ing much of the transcript information. 
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For D/TQ's returned to RTI marked "undeliverable, " a "second- 
best" address was obtained (if available) from the STF and was used 
for remailing the questionnaire. A followup D/TQ was mailed to^non- ' 
respondents a month after the original mailing. ^ - 

Because the ESQ response rate among eligible UB students was 
lower than desired, even with the extra summer admicistrations , . it was 
decided to mail a version of the D/TQ to the previous absentees. For 
each project, when it was decided that no summer makeup session was 
to be held or when siammer makeups were incomplete, the remaining . 
absentees were sent this version of the D/TQ. The first mailiv^j ' " 
occurred in'July, with a follow-up mailing in August. 
5. Mailing of the FSQ and Telephone Followup 

In late September, 1974, the FSQ (Forms UBA, UBB, CSA, ^ CSB) 
.was mailed to all CS and UB students for whom addresses were available. ^ 
A month later, a follow-up FSQ was mailed to the nonrespondents . At 
each mailing, questionnaires returned as undeliverable were sent out 
again to a second-best address if possible.. 

// 

After one mailed follow-up . of. the FSQ, the remaining, efforts to 
contact nonrespondents were performed by telephone. The simples for 
the telephone survey included about 40 percent of all students Who had 
not responded to the FSQ but x^ho had previously responded to the BSQ . 
or D/TQ, and all FSQ nonrespondents who had, also not responded 
previously. 

Experienced RTI telephone interviewers were trained to administer 
the FSQ via telephone. Interviewers made extensivvi efforts to use any 
available source (e^g. recorded addresses, projects, schools) ""to / 
locate the^student' and- to contact each potential source of information 
(e.g., respondent's parents, other relatives, friends , proj ect or 
school personnel) . If any potential source was contacted before the 
student was reached, that source was asked the questions on the FSQ. 
The information obtained on the same student (possibly^ from multiple 
' sources) was recorded in each interview, along with the source. This 
method was employed to maximize the amount of information available on 
the subject.*? should the latter themselves not be reached. The telephone 
followup survey was conducted from he middle of November to the end 
of December 1974. n rj 
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C* UB Staff Questionnaires > 5 

In April 1974, each sampled UB staff member was mailed the appropriate 
PDQ, PCQ, or PIQ. Several types of followup were employed. In mid-May 
1974, project directors were requested by mail to urge the nonresponding 
staff members to return their questionnaire's. In late August, staff ques- 
tionnaires were again mailed to nonrespondents, and lists of these non- 
respondents were sent to the regional Commissioners of Education and regional 
USOE officials asking their help. Finally, in October 1974, the project 
directors of nonresponding staff were telephoned co request their help in 
getting the questionnaires, re turtied • In addition, other telephone contacts 
with the project directors or personal contacts during site visits were 
used to solicit the return of questionnaires. 

In October it became apparent that certain financial, questions in the 
PDQ had not been answered completely or uniformly. Therefore, each .sample 
project director was requested »by mail to send to RTI a copy of the 1973-74 
progranlf year final Grantee Financial Report (OE Form 1227). At the 15 
site-visited projects, directors were asked to provide copijfes of their 
audit reports for the same year. In November 1974, USOE regional offices 
were requested by telephone to help obtain the 0^ Form 1227 and audit 
reports from, projects which had not. pr^pvided them at that time. These 
reports were used to help interpret and supplement PDQ responses to financial 
questions- 

D. Site Visits 

Two-day site visits were conducted at a total of 15 selected Upward. 
Bound projects in the spring and summer of 1974. Findings and perceptions 
from these visits were expected to aid in the interpretation of the pri- 
mary da\:a gathered for the UB evaluation study. They would also serve as 
an additional source for program description data. 

The overall purpose of these visits was to observe, discuss, and 
record the ongoing operations of Upward Bound in order to add a realistic 
prospective to the report of the evaluation study. Hard data were not 
gathered on program operationn or other features of UB projects,- since che 
essential effort was to *^discover what was there*' and aonsrderabls variabil-. 
ity was anticipated. In this respect, it was not possible to approach each 
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visit in the same way or to gather the same kinds of information, partly 
because circumstances varied and partly because of the subjective nature of 
site visits. As a result, the site visit data must be viewed as an impres- 
sionistic and sometimes inferential look at Upward Bound in action) 

After selection of the sites to be visited, explanatory letters were 
mailed to project directors advising them of the. upcoming visit and its 
purposes. Regional TRIO program officers were informed of those ^projects 
selected, and their assistance was solicited in emphasizing the importance 
of the visits in the UB evaluation study. Direct telephone contact was 
piade with the project directors by RTI te,am leaders several weeks prior to 
the proposed visit, in order to clarify purposes, set up schedules for 
interviews, and discuss other related matters. In addition, preliminary 
information was obtained on the nature of the formal programs, numbers of 
personnel involved, and the feasibility of scheduling makeup sessions for 
administration ^of the student questionnaire. / ^ 

Visits were .conducted during the months of April and May 1974 for the 
academic y^ar programs arid during June and July 1974 for the summer pro- 
grams. Selection of dates was typically made l^y project directors, in 
conjUhction with schedules proposed by the RTI team leader. The attempt 
was made always /to ^p Ian two visits in one. trip in the interests of effi- ^ 
ciency and economy. Site visits; typically required two full days in the 
summer and one and a half days during the academic> year . The team con- 
sisted of two persons in all cases. except one, where three were involved. / 

E., Reciiipt -Control 

^ — 

Separate pxro-edures were followed for each instrument in keeping a 
current account c?£ the status of the respondents. A log book was used to 
ent^r the completion status of the BSQ and STF for each sample UB and CS 
student, organi?;ed by project or by feeder school, ?^or tUe D/TQ, a card 
file was maintained on all recipients of the D/TQ, and was used for recording 
and updat\ng the corpletion status of each recipient. A master computer 
•file was subsequently e-stablished to maintain for all sample students their 
addresses and completion status to all instruments. This computer file was 
used directly in maintaining the completion status to the l^^SQ. Einally,^ 
log books were used to record and update the completion status of the UB 
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staff. to their questionnaires, organized by type of questionnaire and by 
project. 



IF. Barly Data Processing , ^ 



Editing- and coding manuals were prepared for all instruments except 

27/ 

-the site visit forms, SARF, and PRV. — & staff was trained to edit and 

c\)de according to the procedures outlined in the manuals.! 

\ lu the case of the B'SQ, the op en-' ended questions Jwere- first' manually 

edited ^nd coded at RTI, and then the contents of the entire questionnaire 

were machine scored and entered onto magnetic tape by the Measurement 

Research Center, lowa -ity. A computer tape for the;UB and CS groups was 

creai^\ed directly from cJited hard copy. Th§ D/TQ, STF, and UB staff ques- 
\ . • ....... . «• . 

tionnAires were all manually edited, coded, ke3rpunched , and verified. FSQ 

\ 28/ ' 

responses .were manually edited and coded- — and directly centered onto 

* ■ ' ' ■ 

magnetic: tape, using direct data entry machines. 



VII. DATA BASES AND COMMONALITIES 



3^ en in 



As seen in Sections V and VT of this chapter, the sources of data for 

this study\were quite-* diverse. Different data elements were collected for 

each of several different groups by various modes ^of collection, at different 

time point:- using different instruments.' Further, some student 'ins truments 

were designdd to collect data exclusively from nonrespondents together 

inst-rj^iments , ^so that student questionnaire responses exist in disjoint data 

sets. T^he resulting large variety corespondents and instruments may 

- ' / 
preseiit, on the surface, a somewhat amorphous set of "partially related but 

seemingly dis3\oint data sets for each of several groups. In this section 

the disjoint groups will be defined, and the commonalities of these data 



27/ \ - / 

— The SARF and PRV were used as ita "sourcef? of final resort and thus 

were not all systematically coded, l^o site visit reports were coded due 
to their subjective nature 

28 / " ^ ' ' ' 

— Hand coding was required on telephone {survey responses because multi- 
ple questionnaires on the same subject coulid have been obtained if rom dif- 
ferent sources. In the manual coding, for each question, only one answer 
(from one of the multiple sources) wa3 selec-ted fo£ coding. The, selection 
was guided by a priority system specified fjor each question; for each ques- 
tion, the system assigned the highest priorities to. sources judged most 
likely to give ^v^lid answers, considej^ing the nature o^ the question,' 



sets and the common data elements making up logical data modules for analysis 
will be examined. 

Table 2.4 defines the disjoint groups-from which data were collected 
and specifies the mode of collection (by instrument) for each group* As 
^can be seen from Table 2.4, the amount of data available for answering 
specific questions regarding the UB program is a function of the common 
data' available, and not necessarily all the data collected. It should be 
noted, however, chat the sources of data available for such groups are not 
the same and thus the information available is not the same. Analyses for 

the entire student group were thus limited to those variables which were / 

29/ / 
•common' to ail subgroups. — / 

For current purposes, subgroups are defined by the particular instru- 
ments .which^group members completed. For some UB participants (or past 
participants) questionnaire information was collected prior to fall 1974 . 
These previous respondents were afeked to provide responses (by mail or 
telephone) only to the FSO(UBA) . Previous nonrespondents vere a^ked to 
respond only to the FSQ(UBB), which solicited critical data not collected 
previously. Previous CS group respondents were asked to complete the 
FSQ(CSA) , and previous nonrespondents were asked to complete the FSQ(CSB). 

i'or analyses involving only UB staff, the data base problem was 
considerably 'reduced although not eliminated. For analyses involving a 
combination of staff quest:* onnaire data with student data,, the problems of 
diverse patterns : of available student information were again en<;:ountered . 

For purposes of addressing various questions to be answeredNs^ this 

study (see Chapter 3) , analyses were directed/ toward a varsity of different 

groups and subgroups of^ respondents. Given a particul^ analysis questioa, 

analyses were^ therefore restricted to data modules containing common data 

• \ I 

elements ior the respondent group under Consideration. The five major 

classes of data modules used in analyses wer^: , - . 

T'X All-student data module. 

2) .Questionnaire-specific student data modules. 



29 1 

— ' Note that UB parLicipants and nonparticipants are further differ- 
entiated by virtue of having been mailed or administered alteriiote forms 
of "^a particular ques tionna ire although there is high commonality among 
alternate'' forms . - 
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Table 2.4 
DESCRIPTION OF DATA SOURCE GROUPS 



^ND DATA COLLECTED 

Data Sources Available 



I. Students 

A. . UE participants (as of fall 1973) 

, 1. ' Still in project in spring 197A 
A. Refusals 

b. BSO administration absentees 
1. Returned D/TQ and FSQ 
ii^' Returned D/TQ but not FSQ 
■ ^- iii.. Returned FSQ but not D/TO 

iv. '^^lonrespon<^e to. both instruments 
. . c. . Pfurtlclpated ir ESQ administration 

' i.. Returned FSQ 

ii. " Nonresponse to FSQ 
2.' No longer ,in project in spring 1974 
. a. Returned D/TQ and FSQ ' 

b. Returned D/TQ but not FSQ* 

c. Returned FSQ but not D/TQ 

d. Nonresponse to both „iastruraents 

B. CS students (in school, fall 19y'3) 

1. In same*, school in spring 1974 

a. Refusals - * 

b. BSQ administration absentees 
i. Retumad FSQ 

ii. Nonresponse to FSQ 

c. Participated in BSO administration 
i. Returned FSQ- 

ii. Nonregponse to FSO 

2. Noc at saii^e school in spring 1974 

a. Returned D/TQ and FSQ 

b. Returned D/TQ but not FSQ 

c. Returned FSQ but not D/TQ 

d. Nonrespoase to both instruments 

II. UB Staff (with project during or prior to- fall 1973) 

A. Project Directors . • 
1. Responded 

2» Nonresponse / . 

B. Counselors ' 

1. Responded 

2. Nonresponse 

C. Instructors 

1. Responded 

2. Nonresponse 



PRV, STF, and SARF 

Ho additional data 

D/TQ(C), FSQ(UBA) 

D/TQ(C) 

FSO(UBB) 

No additional data 

ESQ(E), FSQ(UBA) 
ESQCB) 

D/TQ(B), FSQ(UBA) 
D/TQ(B) 
FSQ(UBB) 
No data 

RSCR, STF, and SARF 

No additional data 

?SQ(CSB) ' 
No additional data 

BSQ(A), FSQ(CSA) 
BSQ(A) 

D/TO (A), FSQXCSA) 
D/TQ (A) - . 
FSQ(CSB) ' 

No. additional data 



PDQ 

No data 

PCQ " 
No data 

tlO 

No data 
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3) Group-specif ic/ student- data modules r 

4) Project data nw^dule. 

5) Questionnaire-specific project staff data modules,, 

A. All Student Data Module 

In addressing ques^tions regarding the entire sample of students, or in 
generalizing to the p-^oulations 'from which they were drawn, one is restricted 
to this data module. The elements of this module are: (1) common elements 
of the BSQ, the FSQ, and the D/TQ; and (2) other, common elements of instru- 
ments such as'STF, SARF, HSCR, and FRV, 

There are relatively few comn/on elements across the BSQ, D/TQ, and FSQ 
because the latter two questionnaires were deliberately shortened. It was 
considered necessary to minimize the length of these two mailed question- 
naire^: in order to increase the likelihood that the respondents would 
coniiii^^ie and, return them. Further, in the case of the D/TQ, it was felt 
that the respondents, being school or project dropouts, were least likely 
to be interested *in completing questionnaires. 

The-'data for this module are, therefore, quite restricted! A major . 
implication of this restriction is that, these are the data from which 
estimates of academic-year Continuation rate were obtained. Any *'cor- 
rections" (to- adjust for initial differences between the participant^|Cnd 
comparison groups) to the continuance proportions, were necessariiy^i^mited 
to the variables of this data module. 

Table 2.5 in<ii'ca)tes commonalities among the various student ques- 
tionna5xes (and thus common q^uestionnairci data' elements for the all student 
data module)," It should be noted that there is a very small number of 
■common variables. The stude^it questionnaire data commonalities, as shown 
in Table 2.5 are: (lVage,' -(2) -sex, (3) a very rough poverty level index ./ 
'determined from number^ of ner^ons supported and reported family income) 
I race;,, (5) grade level ' in fall 1973, (6) activity state (in or out ^o^ 
school, job, post secondary enro.\lment:, high school equivalency enrollment) 
■ u pring 1974,^' (7) reported, high . school GPA for 1972-'73 school year,. 



date of first participation in UB (applies only to UB students) , (9) 



See Appendix , is. for complete d-ifinitions and determination of 
activity states. . oo 
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Table 2.5 . ' \ 



COMMONALITY OF STUDENT QUESTIONNAIKE DATA 



\ 



CS i UB \ CS UB 

BSQ(UB) 3SQ(UB) D/TQ(UB) D/TQ(C3) D/Tq(C) FSQ(A) | FSQ(A) \ rSQ(B) FSQ(B) 

Icea Ko. lcea_Mp. Icea ^o. Icea No. I turn No. Icea Ho. Icem No. ^Icea No. Icem No> 

1 I li^ li? j Tii^ 

2 2 2 2 2 = ■ \2i^ 2^/ 



3 3 



20 20 

21 21 

22 22 
2'5 



24 lU^ 

25 25 

26 26 

27 27 

28 28 



67 51 



5 S Sa 5a Sa U<| Wa 

6 5 3*/ jl/ jl/ ■ , ui>( 

7 7,. /? \ 

8 3 ! 



\ 



\ 

14 14 ■ . ! ) \ 

15 15 , 5b 5b 5b l3b \ 14b 

16 16 \ , ^ \ 

17 17 

18 18 ^ . ^ \ 
19a 19a 9a / 9a 9a 1-*^ p - ^ 3*^^ 
19b l?b ^b 9b 9b - " 3^^ ib^^ 



27 27 4^.' 4i^' 4^' 12^^ 13^^ 



























15 


12 


15 


6 


' 6 


6 


7 


7 


7 


8 


'8 


8 


10 


10 


10 


11 


. 11 


11 


12 






13 




13 



50 50 
51 
52 

53 ■ ; 10^/ 

54 
35 



9^./ 11^/ 



2 3 5 5 

'3 4 6 6 

4 5 7 7 

5 6 3 3 

6 7 9 9 

7 10 



— QUeacloa An , llgfacly dlf fereai fpinn. , 

— ^ Qiieacloa in considerably different fora buc »ane haslc Inf onnacioa. 
Grossly dlifereat fona buc 3aa« type ot Infonaaclon. 
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highest grade- completed, (10) date of last participation In UB (applies 
only to UB students), (11) activity state in fall 1974, and fl2) change of 
UB participation status. For this conmon data base to he available for a 

student, "complete'' data on the student, was required (either 1) compl3tion" 

i 

of appropriate items on the BSQ or D/TQ, or 2) Completion of appropriate 
items on the FSQ(B)). Additionally, other s tudent-relsted data were 
available (to various degrees) which allowed classification of some students 
at one or more points in time and which were used as supplementary sources 
for one or more ^incomplete data items. These dat^. were available from HSCR 
(CS only), PRV (UB only), SARF, and STF. Moreover, the STF provided a 
fairly rich data base regarding high school academic information. 

B» Questionnaire Specific Student Data Modules 

Some of the analysis questions posed can only be answered by use of 
data available from a particular questionnaire (e.g., questions relating to 
students' educational aspiratiorts are only available from BSQ respondents; 
and questions relating to reasons for dropping out of school are only • 
available from D/TQ respondeAts) . Due to different forms of these question- 
naires, any question relating to the entire group of questionnaire specific 
respondents is limited to the common data items on alternate forms of the 

questioiinaires (see Table 2.5). 

« 

C. Group Specific Student Data Modules 

Some student ^analysis questions relate to specific student groups 
defined by a reported or observed classification during the course of the. 
study (e^^ ; high school graduates reporting p'J>6tsecondary educational 
continuariceVssttidents eligible for BSQ administration wL ■ did not respond 
to the BSQ but who responded to one or more other questionnaires) . Questions 
relating to\ these 'specif ic groups are restricted to data modules defined by 
the common data items available for the specified group. / ^ 

. Project Data Module 
This data module provides a spurce of data for addressing questions 
related to the populatipn of UB projects. As specified in Secuion IV of 
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this chapter, the project was the first stage of sampling for all subsequent 
samples described earlier. Thus the common data elements for projects 
included all data from project staff as well as the student data modules 
for UB participants and the CS group, specific to that project. Typically, 
only a limited subset of the data was used in any particular description or 
comparisbr, of projects- When addressing questions at the project level 
regarding student characteristics, aggregated student data vithin project 
was considered (see Chapter 8 and Appendix F) . Most questions related to 
this module concerned data provided in response to t:he UB staff question- 
naires. At the level of project centered questions, questionnaire data 
from counselors or instructor's was aggregated within staff :osition. 

Additional data conmionalit ies exist among the UB project staff question- 
naires. These data wer^e used for descriptive purposes (eog. , describing 
staff members) as well as for project-related analyses. Data commonalities 
among the project staff instrumenti=> played a different role^than student 
data commonalities. Similar questionnaire items relating to perceptions of 
projects by different staff members provided a natural vehicle for examina- 
tion of divergence of perception and opinion within a project and for 
obtaining an aggregate index of project operation. The commonalities among 
these sets of instruments are given in Table 2.6, * 

E, Qgestionnaire Specific Project Staff Data K cdules 

These data modules are completely defined by the PDQ, PIQ, and PCQ, 
respectively. These modules were used in addre.ssing questions related to 
national estimates of characteristics of UB stafl' members within a particular 
staff role. ^ ' 

VIII. OVERVIEW OF DATA PROCESSING 1 

Prior to any considerations of analysis of student or project data, it 
is important to cr- ?sider certain data management und liianipulation procedures 
which have implications for attalysis. A major matter of concern relates to 
the techniques by which the large array of Jata, described in the previous 
section, were distilled and sifted to produce meaningful indices for use in 
analysis. , . 
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Table 2.6 ' 

COJSfONALITIES FOR PROJECT STAFF QUESTIONNAIRES 
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Same personal/inf orsiation but .for different persons. 

Xhfonnation about project or educate .i\ intervention philosophy from different 
points of viev. 
c/ " 

Project related activiti.ii? v-r ; iences of different staff u ambers. . 
d / ' 

,.rr Scale inversion, 
e/ 

— ' Very small connr,ona;..ur7 , qa^>:5 . : is jiarglnally similsr for PD. 
Sciale inversioii *: -. -.Part 1% is .somewhat different for PD. 



h/ 



One category omitted ror PI. 
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There were several factors in the design of the study that created the 
need for considerable processing of the. data prior to analysis. The' use of 
different instruments raises the question of inconsistencies and imputations 
within and among instruments and that of a least common data base (see 
previous section) in analyses relating., to all students or ali projects. 
The matter of differing sources of information (particularly in the* case of" 
the telephone followup~see above subsection VI. B'^; 5 and Appendix A) raises 
the question of^dif f erential validity of data sources. The different time 
periods irxvolved-^^r student data cfieste an additional consideration of ^ 
inconsistency of daVa and logi-cal— imputation betweexi tin^e periods. 

The two major areas relating to data manipulation are: (1) general 
computer checks, edits, and imputations, and (2) development of analysis, 
files. 'These areas are addressed briefly beiow and are covered in greater 
detail in Appendix E. , 

A. General Computer Check, Bdit and Imputation Procedures 

The specific details of editing UF data files were somewhat different 
from instrument to instrument, due pT-p6kxJ.ly to: (1) different response 
patterns:) (particularly skip patterns, inconsistency check patterns, and 
imputable items) , r^nd (2) differential preparation of raw data files (i.e., 
machine scored or keypunched) . There were, however, general principals of 
computer checking and editing. The general form of editing for the files 
was: (1) initial check -.o ascertain that data were in order (sorting of 
records, and sub.rec:. in the case of card format; and deletion or resolu- 
tion of '^noise*' rec'r>:Qs, bad . ID codes., and duplicate recorHs) , (2) supple- 
mental data coding, (3) out of range checks and conversion of all "errors" 
to a standard error code system, (4) routing item checks and appropriate 
coding of inconsistencies, (5) inconsistency checks, and (6) final editing 
step (including complete check of fil: and any logical or stochastic imputa- 
tions) . An overview of. important characteristics of the editing :-3teps is 
presented below. 

If. ' ' - Gexieral Supplemental Codes and Error Codes 

This step .involved creating a supplemental coding system which 
(a) allowed a supplemental code identifying inconsistent items withxn 
a record, and (b) allowed a jupplcmental code to identify data which 
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had been imputed. The supplemental code allowed such data to be ^ 
selectively screened for analysis (see Appendix E for specific details 
of the system) . 

In addition to the supplemental codes, cedes were developed and 
used to denote certain types of responses that nomu?.Ily are not 
usable in analysis. Specific codes were developed to" identify 
nonresponse, legitimate nonresponse, multiple response, nonresponse 
inconsistent with routing items, -out of range response, ^'don't know'* 
response, refusal, item not administered (used for merged files 
•containing different forms of the same instrument), and unavailable 
response (indicating quertionnaire nonresponse). These coding proce- 
dures are detailed in Appendix E. - 
2. ^Routing Item Checks 

There are a variety of routing items in the various UB Instru- 
ments. The simplest type is a skip pattern and is llluscr-^.ted by the 
following diagram in which the answer to A routes the respondent to 
either answer B through G'or to skip B through G and proceed to item H. 




Items B~G 



Item A 




p Item H 



In general, editing procedures produced a supplemental data code or 
error code when a routing question or data inside a slcip pattern were 
answered inconsistently with respect :'o' other data in the skip pattern. 
For more complex routing items, i. e.. , rdouble branching or nested 
patterns, analogous techniques and codes were used.. 
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3. Inconsistency Checks 

A series of inconsistency checks was p-srformed for each instrument. 
The "specif ic. checks performed varied from instrument to instrument. 
Data items found to be inconsistent on any- check were assigned a 
specific supplemental data code. 

4. Imputations 

There are two different, types of imputations. Different supple- 
mental code values were assigned to imputed data on the basis of the 
type of imputati^fiinr performed , The first type of imputation is that of • 
logical implic^^tion from exist iug data. For example, a student may 
have indicated t^hat he was in high school at a given point in time, / 
but neglected to give his grade. If, at the same point in time, that 
student indicated that the highest grade he had completed was the 
•tenth grade, one could deduce that his grade level at that time point 
was-, the eleventh grade. 

A second type of imputation performed is a stochastic inference 
from 'existing data element?. As an example, a. student may have indi- 
cated that he was in high school in grade n during the spring of one' 
academic year and also in high school the following fall without . 
indicating gr'ade level for the fall. For n < 12, it is highly probable 
that the individual is in grade n + 1 in the fall (for n = 12. the 
logical imputation is still in grade 1,2 in the fall) . This will not 
necessarily hold for every case (since the student may have failed to 
advance); however, in the large majority of cases, such an imputation 
would be correct. 

3. Analysis File Construction . 

The analyses performed for this study may be categorised into four 
m^jor groupings: (1) student oriented analyses, (2) project staff analyses, 
(3) project specific analyses', and (4) project by student analyses. The 
scope of these analyses is documented in /Chapter 3 and will not be considered 
here; rather, this section will examiny some manipulations of data necessary 
for conducting such .Urinalyses. These procedures are more fuixy documented 
in Appendix E. . o . - 
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In Section VII, the reader was intxoduced to the dis3:pint data sets 
collricted from students, staff, and othar sources. For most of the analyses 
the original questionnaire data sets as separate entities were insufficient 
for analysis , even when augmented by sampling weights. For example, exami- 
nation of response.;^ to the BSQ (an analysis si. *, cific to one set of respon- 
dents and one data set) was undertaken only after data external to the BSQ 
file were examined and appropriately merged with the BSQ data (i.e., high 
school grades from the STF file, external validation of student status). 
The rather lengthy and complex set of merging operations .prior to actual 
analysis is discussed in Appendix E. Various procedures for validating and 
datannining activity states are treated briefly below. 
1, Determining Student Activity States 

Any analysis of the student data within the general model proposed 
/subsection II,A) would seem to require, if nothing else, the identi- 
fication of activity states of students in the sample at three points 
in time. This determination, however, presented one of the major 
problems encountered in file preparation. The difficulties stemmed . 
primarily, fro^. the many different combinations of data sources poten- 
tially available for any one student. , 

The simple classification -of in^school or out^of-school is too 
limited to truly depict the dynami.cs of an individual's transition 
through the educational system. The more complete classification 
system used for analysis, is sketched below. 

In classifying individuals as to activ^^ty state; two or more 
classifications were used. The primary classification was strictly 
related to the time points considered in the study (i.e., fall 1973; 
spring 1974; and fall 1974), and related primarily to in-high-school 
or out-of -high-school status. The second (or third or fourth) classi- 
fication areas are conditional on the primary classification and 
provide in some cases historical information. The -secondary classic 
fications used related to: work status, grade in hivh school, post^ 
secondary education (PSE) status, highest grade completed, and status 
regarding high school equivalency programs (HE?). 

Information relating to the particular mode of classification at 
% ■ 

a sxngle time point was often obtainable from diverse sources, but^was 



not in all cases available. Wheu information was availo^ble from 
several sources, uhere was not always complete agreement as to classifi- 
cation from tha riifferent > ources. A complete listing of pote*itial 
sources of data from which a student status might have he'm determined 
is given in Appendix E. Additionally, the systems by which activity 
states were determined are included in Appendix E in the form of 
decision trees. An example of this syst^ for the simplest time poi^t 
classification (CS students in fall 1973) is shown in Figure 2.7. 

For a given time point V ' ^ i are various sources of information 
regarding an individual's activity ststo, as ^can be seen from Figure 2.7 
Different instruments or questions within instruments provide one 
dimension of source differences, while different persons from whom the 
data are obtained is another dimension. Within the FSQ telephone 
followup data, the second dimension exists within a specific instrument; 
in all other cases,' a particular source is *associated with a specific 
instrument. One may oFserve the implied hierarchy of data sources 
used in determining activity state from the example ^hown in Figurci 2.7. 
In assigning high school status, for example, the order of acceptance 
of information from various data sources is: 

(1) High school staff. — - 

(2) Respondent. • . 

(3) Respondent's spouse. 

(4) Res?pondent ' s parents. 

(5) Friend. 

(6) Project staff (for UB participants only). 

An ordering of data sources regarding other aspects of each student *s 
activity state (secondary classif icat.lons other than grade level or 
highest grade completed) is sdLmilar to that given above extfept that 
high school staff (normally unfamiliar with ^i^tudent's activities after 
he leaves school) were given lowest priority. A specif icatiwi of such' 
implied hierarchies of data sources is given in Appendix E. Actually 
all available information relative to aii activity state was examined. 
The classification \^as determinecf from the highest ordered data source - 
from which classification information was obtainable. In addition to 
the standard lead digit codes, coded activity state information was 
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also supplemented by additional codes: (1) a code indicating the 
source from which the classiiiication is made, (2) an inconsistency 
code indicating whether the. classification was consistent with all 
other available data within the time period. - 

In addition to inconsistencies within a specific time point, ■ ^ 
there are additional i consistencies th^t resulted from classif i- 
cations at two or mora time point<5. For example,- the classification 
"In High School Grade 10" in fall 1973 Is inconsistent v; :h tiik 
classification "Graduated Hie.h School'* in spring jfsTA. Hor^ve?>- it 
was possible to impute responses at one time period from t^o^e at 
anofher (.some approaches have already been specified abovejf . Examples ^ 
of some straightforward imputations are: / \ 

(1) '^Graduated ^in spring 1974" would suggest a grade level of 12 
in fall 1973 if the individual could be identified as being 
in high school at the earlier tide (si^iilarly for fall 1974 , 

r and spring 1974) . v 

(2) '*In grade n in fall 1973" or "spring 1974" would normally 

\ 

indicate the student was in the same grade at the other tpne- 
period (provided he was in high school at both points) . \ / 
tiHien imputations were perrormed, thc^ appropriate -imputation code>^/ 
was added to the data element so imputed* Inconsistencies across time 
periods were noted by the supplemental inconsistency code specified in 
the preuious section. " *V 

2. Determining Other Critical Variables' for ^Analyses 

In. addition to determining primary and secondary activity states ^ 
at three points in time, it was important for- the overall student 
analysis to determine other class-tf icatory v-iriables for the respondents 
Specifically, the remaining /Classif icatory variables among the common 
"data items are sex, age, race, and povercy index. Further , information 
relating to high scnc^ courses played a major part in these analyses. " 
Finally, it was imporj^nt to ascertain whether: (a) students in the 
UB sample were, in fact, UB participants at the three discrete time 
points; (b) st\^depts' in the CS sample had 'participated in UB either 
before or af ter^selection; and (c) . the length of participation for UB 
students. These important determinations are detailed in Appendix E. 



Chapter 3 

Overview of Analysis: General Approach gad Limitationg 



In previous chapters, the narure and methodology of the colD.ection and 
processing of student and project dues have been sketched. This chapter 
^>rovide.s an overview of analyses that were performed and the various proce- 
dures used to extract the most important and relevant information from the 
data- This chapter also provides an insight into analysis limitations 
through an appraisal of the quality of data returned, including examinations 
of nonresponse, reliability , and basic differences between certain respondent 
subgroups. ' 

To guide analysis, an "analysis advisory group was formed, con^sisting 
of nationally prominent: analysts (see Appendix K) . RTI submitted to USOE 
on 5 December 1974 an analysis plan, which was modified somewhat as a 
result of a meeting of ' RTI staff, USOE project monitors, and the analysis 
Advise - y group on IQl.and 14-4)ecember 1974. While the advisory group provid- 
ed thot v/ntf ul insight into analysis problems and strategies, many of the 
valuable suggestions pffered^by the group could not be implemented due to 
constraints on cne da^a (see Chapter 2, Section VII) and limitations in 
time and funds. Where possible, suggestions were incorporated .into the 
analyses. Aluhough the advisory group provided valuabxe input into ths 
plans for analysis, tl^ey served in a purely advisory ^:apacity and the 

resultant analys'is strjategy is the sole product and responsibility of the 

* ■ f 

RTI analysis team. ! ' ' 

In addition to routine analyses for questionnairp and item nonrasponse, 
data reliability, and subgroup bias (presented ±} this chapter),, there art 
three major classes ofl analysis: (a) student priented analyses, (b) program 
oriented analyses aid (c) project by student analyses- General features 



project specific analy 



-^^ This analysis clafes subsumes the project. staff analyses and the 



5es introduced in subsection VIlI.B of Chapter 2, 



of these classes are given below, while specific analyses and results are 
presented in detail in subsequent chapters. 

A. Student Qiiented Analyse s 

The most general questions concerning UB and control :,tudents are 

exauined in the student brieiited analyses which are presented in Chapter 7." 

In these evaluations the unit of analysis is the student, and analysis 

variables are typically those cciiiE?on to all students (see subsection VILA 

of Chapter '?.) which subsequently comprised the major portion of the Student 
2/ 

Master File.— The analyses are conceptually quite straightforward although 
ir. seme cases they become operationally complex, Thay focus priniarily on 
differences between UB participants and nonparticipants . 

These analyses speak to the critical questions of the effectiveness of 
the UB prpgram. The questions to be answered are value-laden and neces- 
sarily sensitive ones, and every effort has been made to insure that mis- 
interpretc^tions do not occur from spurious resultis, - Analysis bias, either 
favorable W unfavorable to the program, has been avoided to the greatest 
extent possible. For these analyses, therefore, appropriate adjustments of 
data were quite, crucial. Extensive care has been taken to adjust, where 
possible, for any existing differences between participants' and nonpartici- 
pants in terms of variable, classes not directly pertaining^' to program 
partr.cipation (i.e*, moderating variables such as dif ferenVj al baseline 
measures and/oir differential operation of relevant external processes), as 
suggested by the process model. ^ 

The approach in selecting cou*parison students reduced soma of the 

major differences between UE participants and^-cdraparison stud^.nts along two 

major dimensions — poverty 'level and ''academic risk" status — thus reducing 

the extent to //hich. statistical adjustments were required. Technique's for 

such adjustments, particularly in the case of dlf f€^rences between participants' 

and nonpar ticip^tnts on large- numbers of basically qualitative variables ; 

3/ ' 

become quite complex.— For this reason, the sampling plan was designed to 



2/ ' • ' 

The Stddent Master File is discussed more fully in Section IV of this 

chapter and in Appendix E. V 

-^^ See Appendix iL_f or .s'p^icific adjustment techniques used for student, 
analyses. 



reduce the probability of major group differences in such critical variables 
as: class in school, region of country, rural-urban location, poverty 
status, and classification as ''academic risk" (see Chapter 2, subsection IV. A 
and Appendix B) . In the main, the sampling plan was effective toward this 
end* 

B. Program Oriented Analyses 

In the program oriented analyses, reported in Chapters 4 through 6, 
the thrust is descriptive. These descriptive analyses are divided into 
three sections. One section uses the individual project staff as the units 
of analysis (Chapter 4). The directors, instructors, and counselors, as 
well as their activities over all the sampled projects are described. This 
organization of the data^ allows the investigation of questions regarding 
the characteristics of staff members for the UB program in general. Within 
this framework, estimates of national characteristics of UB staff members 
are produced. 

The second portion of the descriptive analyses (Chapter 5) concerns 

the project. Data are aggregated over the individuals of a given staff 

category within a given project to determine global aspects of project 

4/ 

organization without regard to individual staff members.— For these 
analyses, indices of project variables wera developed by combining certain 
questionnaire items and subitems within the three project staff questionnaires.-^^ 

The third portion of the analysis (Chapter 6) examines .perceptions of 
the program by the UB participants. Since no CS group data are used, these 



— Since there was but one director in each project, aggregation was 
unnecessary for that staff category. For the counselor and instructor 
staff .categories, however, there was potentially more than one set of 
responses for a given project (e.g., more than two instructors were sampled 
and responded to the PIQ) . Where th±o was the case, an aggregate of coun- 
selor and instructor responses to a particular questionnaire- item was com- 
puted, and this single response was used as "the response'' from that staff 
category within that project (see Appendix G for a more detailed discussion 
of the aggregation procedures) . 

— ^ The rationale and procedures used in the reduction of several items 
or subitems into more general variates are described in Appendix G. 
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analyses concentrate on those portions of questionnaire data that are not 
connaon between the CS and UB group. Such data are typically the impressions 
of UB students regarding the UB program or their specific project. 

C. Project by Student Analyses 

k final class of analyses focuses on an invec^tigation of relationships 
between a set of variables reflecting project structure and function and 
the sets of student input and output measures. Results of these analyses 
are reported in Chapter 8. Project variables were derived by further 
aggregation of questionnaire results over staff categories—^ or from items 
unique to specific staff categories (e.g., level of experience of project 
instructors). Student data for a given project were collapsed into a set 
of measures aggregated over the students of that project, providing a 
single value for each project on each student variable considered. The 
aggregate measures were computed from the data items common to all UB 
students over the various UB instruments (see Appendix G for procedures 
used). These aggregate student measures, classified by various project 
dimensions were then examined. This class of analysis allows a broad 
variety of questions relating to "project effect" to be posed and 
investigated. 

In the project by student analyses, concern shifts from the national 
program effectiveness to differences in project outcomes as associated with 
structural and/or functional project differences. This entire class of 
analysis evaluates differential program operation. As such, it examines 
the relative value of particular approaches to the general UB objectives. 
The question of the value of program participation per se is treated in the 
student oriented analyses. 

D. Other Preliminary Data Examinations 

In addition to these three classes of analysis, other routine analyses 
were conducted. In order to provide accurate estimates for the major 
analysis classes, the data were frequently adjusted for nonresponse (see 



— The commonality of items over staff questionnaires, discussed in 
subsection VII. D of Chapter 2, allowed such aggregation. Appendix G 
gives details of the procedures used in obtaining these aggregates. 
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Appendix F); therefore examinations of both item and instrument nonresponse 
were conducted to guide these subsequent adjustments. An examination of 
data reliability was also undertaken, and studies were conducted to inves- 
tigate possible biases due to self selection in certain analyses that were 
restricted to subsets of students. All such studies are presented below in 
this chapter (Sections III, IV, V, and VI). 

Tli ORGANIZATION OF ANALYSIS: SPECIFIC ANALYSIS QUESTIONS 

In general, the organization of data analysis follows the partitioning 
sketched in Section I, but within each category of analysis (analysis 
class) there are further classifications leading to specific sets of 
analysis questions, or hypothesis, to be addressed. This approach was 
dictated by several constraints on analysis planning. First, both time and 
budget constraints prevented an extensive data oriented analysis—^ of the 
student data, and, secondly, the nature of much of the data collected by 
this design did not facilitate a data oriented analysis. The balance that 
has been struck between an hypothesis testing approach and an hypothesis 
generating approach is probably a good one for this study. More extensive 
"data-snooping" and attempts at empirical scale construction within the 
student analyses might have proved fruitful; but in a study where major 
emphasis centers about a few key issues, hypothesis testing should be the 
major concern. 

Given these considerations, the analysis, in general, specified 
a priori classifications of variables or research questions. The nature of 
these questions and the data sources allowing their investigation pre- 
scribed the final determination of analysis organization and schedule. 

The outline presented in Table 3.1 details the specific list of 
research questions investigated. In addition to the questions, the data 
required for an answer and the chapter of the report in which the questions 
are addressed are shown in Table 3.1. For simplicity of presentation 



— A data oriented analysis is one that examines the data without a priori 
hypothesis. For example, many factor analytic or multidimensional scaling 
studies approach the data to find what is there in terms of data structure 
or data relationships. 
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Tabl* 3.1 

AS OUTLINE OF A^TTIC QUESTIONS 



QuescloQ and Chapcer Reference 


Mlntnal Data Needed and Source^^ 


b/ 

Moderator Variables- 


I. Quesclotis Concemins; Encire Scudenc 
Group 

A. Is educaclooaX continuance. Including 
?S£ £ncry for seniors, a function of 
U3 parcldpacion? 
(Chapter 7) 

3. Is acadeaic CPA change a function of 
03 parclclpaclonZ 
(Chapter 7) 

C. Is course type change (nonacadeaic — > 
acadealc) a function of UB particle 
patlon? 

(Chapter 7) 

D. Is acadenic course level change 
(reaedlal^^general-'^advanced) a 
function of U3 participation? 
(Chapter 7) 


Educational status at three points, extent 
cf U3 participation (Master File). 

Statt2s in fall 1973, extent of UB partlcl'- 
patlon (Master File); CPA information for 
Grade 9 and current grade (STF) . 

Status in fall 1973, extent of UB parclci^ 
patlon (>!aster File; course type for Crade 
9 and current grade (STF). 

Status In fall 1973, extent of U5 partici- 
pation (Master File); course level for 
current grade (STF) . 


Poverty Index, Aca- 
demic Risk Index, Sex, 
Race (Master File) . 

Poverty Index, Aca- 
demic Risk Index, Sex, 
Race (Master File). 

Poverty Index, Ac£- 
demic Risk Index, Sex, 
Race (Master File). 

Poverty Index, Aca- 
demic Risk Index, Sex, 
Race (Master File). 


II. Questions Concemini? Soeclflc Student 
Sub?rou3S (Kot Coapletely Questionnaire 
Dependent) 

A. What, If any, are the effects of U3 
participation upon those students who 
drop out of high school? 
(Chapter 7) 

3. Is the type of PSE entered by high 
school graduates a function of U3 
participation? 

(Chapter 7) 


Extent of UB participation, status at 
three points In tia«, HEP^ status 
spring 1974 and fall 197A (Master File). 

Extent of UB participation, school status 
at three points (Master File), types of 
PSE entered (FSQ) . 


Poverty Index, Aca- 
demic Risk Index, Sex, 
Race (Master File) . 

Poverty Index, Aca- 
demic Risk Index, Sex, 
Race (Master File). 


III. Questions} Regarding Subgrouos Defined 
by Specific Questionnaire Conoletlon 

A. ESQ Respondents 

1. What arc the similarities and dif- 
ferences between UB and CS students 
in tenss of important baclcground 
vai*lables? 

(Chapter 7) 

2. What are the relationships of U3 
participation to: aelf-esteen and 
locus of control, educational and 
occupational aspirations? 

(Chapter 7) 

3. ?or 11th and 12th graders only: 
What are the relationships between 
UB participation and PSE plans and 
actions tak^n? 

(Chapter 7) 

3. BSQ-3 P.espondents (UB only) 

Hov is the UB prograa perceived by 
participants? 

(Chapter 6) 


Extent of UB participation (Master File); 
participation In other programs (Q. 24,23); 
parental education and occupation (Q. 17, 
IS); parental aspirations for student's 
education (Q. 32); type of cocasunity 
(Q. 10); type of study program in Crade 9 
(Q. 20). 

Extent of UB participation (Master File); 
selfresteen (Q. 28); locus of control 
(Q. 29); educational aspiration (Q. 30,35); 
occupational aspiration (Q. 34,35). 

^Extent of UB participation (Master File); 
actions regarding PSE (Q. 38,^0); types and 
nuaber of schools applied to (Q. 41,44); 
acceptance to PSE (Q. 42,43); application 
for and obtaining of financial aid 
(Q. 45-50). 

Source from which first heard of UB (Q. 51); 
activities available, engaged in, and per" 
ceived helpfulness (Q. 55); others' percep- 
tion of self (Q. 56); canily effect (Q. 57); 
evaluation of components (Q. 59,60,64,65); 
benefits (Q. 61); extent of C3 participation 
(Q. 52). • 


Seic, Race, Grade (fall 
1973), Age, Academic 
Risk Index, Poverty 
Index (Master File). 

Sex, Race, Grade (fall 
1973), Age, Academic 
Risk Index, Poverty 
Index (Master FUe) . 

Sex, Race, Crade (fall 
1973), Age, Academic 
Risk Index, Poverty 
Index (Master File). 

None . 
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3.6 



7«ble 3.1 (coacinued) 



Quescioa and Chapcer Reference 


Misisal Data Needed and Source^^ 


. jk , 

Moderator Variables^^ 


C. Reliabilicy Scudles 










1. Is the April 1974 aciiool stacus 
reported on aSQ comparable co that 
recorded on other laatruacnts? 
(Chapter 3) 


April 1974 school status (BSQ); April 1974 
school status (STF and SARF). 


None. 






2. la school nzrz\i3 for fall 1973 
reported on 3SQ conparabla to that 
previously reported ou project 
roster (or for CS, by high school 
on HSCE)? 

(Chapter 3) 


Fall 1973 school status (BSQ); Fall 1973 
school status (PRV or HSCR) , 


None. 






3. Are D/TQCO responses to school 
status in fall 1973 consistsot with 
the PD report of fall 1973 status 
on project roster? Axe D/TQ(C) 
responses co school status in spring 
1974 consistent with project staff 
responses reflected on the SARF or 
the STF? 

(Chapter 3) 


School status fall 1973 and spring 1974 
(D/TQ(C)); school status fall 1973 (PRV); 
school status spring 1974 (SARF); school 
stacus spring 1974 (STF). 


None 






4. Are D/TQ(3) responses to scbv»ol 
status in fall 1973 consistent with 
^be status as reported on project 
roster (UB only)? Are D/TQ(A or 3) 
responses to school status In spring 
1974 consistent wttn school status 
as reported on SARI or the STF? 
(Chapter 3) 


School stacus fall 1973 and spring 1974 
(D/TQ(A&B)); school status fall 1973 (PRV): 
school status spring 1974 (SABF); school 
status spring 1974 (STF) , 


None, 






3- Are FsqiusB; response to school 
status iu fall 1973 consistent with 
the status as reported on project 
raster fUB nnlv^'' & «. ^ Tcft/i»"% 
responses to school status in spring 
1974 consistent with status 
reported on 3ARF or SX?? 
(Chapter 3) 


School stacus fall 1373 and spring 1974 
(FSQ(B)); school status fall 1973 (PRV); 
school status spring 1974 (SARF); school 
status spring 1974 (STF), 


None. 






IV* Questions Rewrdin? Conroarison of Sub- 
Groups Defined o'r Specific duestionnaire 
Comoletion (Indicators or Analysis' Blasts) 










A. Are characteristics of BSQ(B) respon- 
dents different frota absentees who 
subsequently respond to D/Tv^(C)? 
(Chapter 3) 


Age, sex, race, poverty status, grede 
level, school status in fall 1973 and 
spiring 1974 (Master File). 


None. 






3. Are characteristics of 3SQ respondents 
different froo D/TQ(A&3) respondents? 
(Chapter 3) 


13 participation status; age, sex, race, 
poverty status, grade level, school status, 
in fall 1973 and spring 1974 (Master File). 


None. 






C. Are characteristics of BSQ or D/TQ 
respondents different frcQ those of 
F5Q (3) respondents ? 
(Chapter 3) 


Age, sex, race, poverty stands, grade 
level, school status in fall 1973 and 
spring 1974 (Master File). 


None. 






D. Are characteristics of 3SQ or D/TQ 
respondents who do respond to FSQ(A) 
different from those .who do not 
respond to FSQ(A) ? 
(Chapter 3) 


Response status for FSQ(A) (Master File) ; 
age, sax, race, poverty stacus, grade 
level, school scatus in fall 1973 or spring 
1974 (Master File). 


None. 






V, Questions Concerning Descriotive Char- 
acteristics of UB Proiect Staff 
(Directors, Instructors, Counselors^ 
A. Project Directors^' 










1. Vhat are the demographic character- 
istics of the project difectcfs? 
(Chapter 4) 


Age (2A); sex (23); race (3); conmunicy 
background (5); family background (6,7). 


None. 







- continued - 
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Table 3.1 (continued) 



Queacloa and Chapcer Reference 


MlElaal Data Needed and Source^^ 


Moderacor Variable*^^ 






, Whac is che average and range of 
experience and cralning for UB 
direccors? 

(Chapcer 4) 


Experience wlzh disadvantaged students 
(IB.IC); degree level (3); currenc enroll- 
ment (10); special training (UA.llB). 


Sone. 




3. 


Whac are che acclcudes of che 
projecc dlreccors on issues zha.z 
have iopacc on cducaclonal inCer- 
veacion prograas? 
(Chapcer 4) 


Philosophy of education (23); attitudes 
Cavard stud«ics (34). 


I^one . 




4, 


How do projecc dlreccors divide 
chelr else In running a projecc? 
(Chapcer 4) 


Breakdown of cine spenc (13) v 


Hooe. 


a. 


e/ 

Project lascruccors— 








1. 


Whac are che deaographic characcer- 
iscics of che Inscruccors? 
(Chapcer 4) 


Age (1); sex (2); race (3); cocanunicy 
background (5); faally background (6,7). 


None. 






Whac is che average and range of 
experience and craiaing for U3 
lascructors? 
(Chapcer 4) 


Training (8,10,11 ,12, 23a) ; experience (13, 
14a, 15) . 


None. 




3. 


Whac are rhe accicudes of che 
inscruccors wlch respecc co issues 
chac lopacc on educaclonal incar- 
vencion prograsis? 
(Chapcer 4) 


Philosophy of educaclon (29); accicudes 
coward scudencs (35); lapoccance of vhac 
they ceach (30) . 


Sone. 




4. 


How is che else of che inscruccors 
brokea down and how nuch cimc is 
devoced co ceachlng? 
(Chapcer 4) 


Time breakdown (26); parc-claie/full-ciae 
(16a, 163) ; ocher esploynenc (17) ; number 
of classes caughc (20B) ; techniques used 
(23). 


None. 


c. 


trojecc Counsalora^^ 








1. 


What are che denogr&phlc chataccar* 
iscics of UB counselors? 
(Chapcer 4) 


Age (1); sex (2); race (3); conaiunicy 
background (5); family background (6,7). 


None. 






Whac is che average and range of 
experience and training of IJ3 
counselors? 
(Chapter 4) 


Degree level (3) currenc enrollmenc (10); 
special craining (11A,113) ; counseling 
craining (12,13,14,15A,16) . 


None. 




3. 


Whac are the counselor attitudes 
with respect to issues chat ijupact 
on educational intervention 
programs? 

(Chapter 4) 


Philosophy of educacion (30); ncclCudes 
coward scudencs (34). 


None. 




4. 


Hov is the counselor's else spent 
in a U3 project? 
(Chapter 4) 


Full-clne/parc-ciae (17) ; clae breakdown 

(25); lengch of counseling sessions (26); 
number of sessions/scudencs (27). 


None. 


VI. Deacr 


iptive Questions Concemina Proiects 






A. 


Whac are she demographic characcer- 
iscics of the project? 
(Chapcer 5) 


Age of projeccs (PDQ lA) ; average taonchly 
enrolltaenc (PDQ 413); projecc emphasis 
(PDQ 17,22; PCQ 20; PT.Q 25). 


None. 


3. 


Whac are che coses and scafflng 
paccerns of projects? 
(Chapcer 5) 


Projecc Coses (PDQ 38, 40, 41); projecc 
scaffing (PDQ 19, 20) 39. 


^'one . 


C. 


How do che projeccs differ in chelr 
sponsors, chelr kijid or sponsorship, 
and their conmiccee scruccure? 
(Chapcer 5) 


Projecc sponsorship (?DQ 12A,13,14,26; ; 
Relacions wich high schools and PS£ groups 
(PDQ 31; PCQ 33; PIQ 39a) ; conniccee 
scruccures (PDQ 24,25,27). 


None. 
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(rather than theoretical demands) , the analysis questions have been outlined 

according to the sources of data required (see Chapter 2, Section VII) . 

Question-grouping I contains questions concerning the entire student 

sample (Upward Bound and Comparison Students), drawing upon the Studerit 
g j 

Master File.— Grouping II contains questions regarding specific student 
subgroups, for which data is obtainable from various student questionnaires. 
Grouping III contains questions dealing with student subgroups defined by 
their completion of specific student questionnaires. Grouping IV contains 
questions involving the comparison of different student subgroups, defined 
by different student questionnaires. Grouping V contains questions concern- 
ing characteristics of Upward Bound project staff, as defined by specific 
staff questionnaires. Grouping VI contains questions regarding projects, 
as defined by data obtained from various staff questionnaires. Finally, 
Grouping VII contains questions concerning the relations of project charac- 
teristics to student outcomes, drawing upon various staff and student 
questionnaires. 

III. INSTRUMENT RETURN RATES AM) DATA QUALITY 

Analysis plans for this study were formulated with the expectation 
that data for all individuals in the sample would not be available due to 
instrument (questionnaire) and item nonresponse. The extent of question- 
naire nonresponse can, of course, influence the validity of results, 
since self selection, in the foriQ of questionnaire return, may produce data 
for a very biased subset of the sample. Within the subset of eligible 
sample members returning questionnaires, omission of items, failure to 
follow instructions, and logical inconsistencies in item responses provide 
additional sources of data deterioration which may affect the results 



obtained. In an attempt to resolve some of the problems of missing data, 

9/ 

imputation procedures were implemented,-— and while the "net gain from sucl 
procedures should be positive, it is possible that imputations introduce 



8 / 

— See Sections VII and VIII of Chapter 2 and Appendix E for discussion 
of the common var^iibles available to all students. 

9/ 

— See Chapter 2, sul 
imputation procedures. 



9/ 

— See Chapter 2, subsection VIII .3, and Appendix E for discussion of 
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some error into the data for some individuals. An examination of these 
various sources of potential error is the subject of thdLs section. 



A. Student Sample Size 

The student sample sizes employed in this study are given in Table 
3.2 by project and by feeder school—'^ within projact. The table provides 
both "original" and "corrected" sample sizes. The original sample size is 
the number selacted by RTI on the basis ot information provided by the 
projects (on the PRV) or the feeder high schools (on the HSCR) . When field 
administration of questionnaires commenced, certain discrepancies in the 
original sampling rosters were noted, and corrections were made, yielding 
the corrected figures. The UB sample, as originally drawn, numbered 
3747. A total of 83 students were deleted from the original sample roster 
because they had been misclassif ied as to project membership on the PRV.— ^ 
A total of 46 students were added because they had been incorrectly omitted 
from the PRV yielding a final total of 3710 UB students in the sample.—^ 
The original CS sample totalled 2401. From this total, 61 students 
were deleted because they were identified as Upward Bound participants,—'^ 
or because they were found to be special education or homebound students. 



10/ 

— Recall that a feeder school has been defined basically as a high 
school sending students to an Upward Bound Project (Section IV .A of 
Chapter 2) . 

— Misclassif ications included duplicate roster entries and inclusion 

of names of students no "".onger in the program at the stipulated time period 
(fall 1973) . Only a small proportion of this number resultfed from errors 
by project staff in completing the PRV. The bulk of errors resulted from: 
(a) use of uncorrected rosters provided by USOE for those projects not re- 
sponding with a corrected roster, and (b) data entry errors at RTI creating 
duplicate listings. 

12/ ] 

— These errors of omission resulted in more or less equal numbers from 
errors made by project staff in completing the PRV and from use of uncor- 
rected rosters for projects not returning the PRV. 

13/ 

— Although high school staff members were asked to exclude from sampling 
lists those students who had participated in UB, this type of error was 
anticipated. It was unreasonable to expect that all high school staff mem- 
bers would be aware of the UB membership status of every student in school. 
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Hence, the final CS sample was 2340. From Table 3.2, it can be seen that 
with the exception of project number 4, in which a large number of students 
were deleted from the original roster due to an data-entry error creating 
duplicate roster listings, there are no marked differences among projects 
or feeder schools in numbers deleted or added to the original roster. 

B. Instrument Return Rates 

Return rates for the various questionnaires as well as properties of 
the distribution of return rate by project are reported in Table 3.3. The 
properties of the return rate distribution which are presented are the 
minimum, the first quartile (Ql), the second quartile (Q2) , the third 
quartile (Q3), and the maximum.—^ All Instrument return rates were 
determined on the basis of "eligible"i^/ respondents. Because of the 
complex questionnaire administration— overlapping populations, subsampling, 
differences in time of administration, and differences in mode of administra- 
tion—differing return rates were expected, and thus comparison of return 
rates across instruments provides little useful information. Followup 
instruments (such as D/TQ(C) and Form B of the FSQ) , mailed to students who 
had previously not responded, were expected to yield low return rates. The 
decision to subsample in the telephone followup instruments deflated the 
FSQ telephone administration return rates (i.e., not all eligibles were 
subsampled for administration, but among those who were sampled, the response 
rate was greater than 95 percent) . The return rate for the STF is 



14/ 

— Ql is the point in a distribution above which 75 percent of the cases 
fall and below which 25 percent of the cases fa.ll. Q2 (the median) is the 
point in a distribution above which and below which fall 50 percent of the 
cases. Q3 is the point in a distribution above which 25 percent of the 
cases fall and below which 75 percent of the cases fall. 

~ Not all sampled students were eligible for administration of all stu- 
dent instruments (see Chapter 2, Figure 2.5). For example, only those 
students still in the UB project at the time of administration were eligible 
for the BSQ(B) . And only those no longer with the project were eligible for 
the D/TQ(B) . The use of such eligibility requirements provides a more 
realistic picture of response rates. 
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Table 3.3 
IKSTR'JMENT RSTUIIN KATZS 



----- - 1 






Percenc 














Number 
Slieible 


Re cum 
"or All 

Elii?ible3 


Discribucion of 


Perceac Recura 


by Prolecc^' 






QL 


02 


Q3 


Maxiaua 




?Dq 


54 


88. 9Z 




— 


— 




— 


PIQ 


2X1 


72.9 


25. OZ 


50. OZ 


77.52 


100. OZ 


100. OZ 


?CQ 


104 


SOeS 


0.0 


50. G 


100.0 


100-0 


100.0 


CT^ t • ^ ^ f 

Sir \rt>; 




77.1 




100.0 


100.0 


100-0 


100.0 




3710 


100.0 


100.0 


100.0 


100.0 


100.0 


100.0 




258 


25,6 


0.0 


0.0 


29.7 


50.0 


100,0 




J / J 


Ji .0 








lUO. 0 


100 .0 




573 


47,3 


0.0 


32.3 


50,0 


67.9 


100.0 




2082 


35.1 


26^2 


82.7 


90.4 


95-0 


100.0 


c/ 

3SQ(3)— 


J Jj/ 


52,0 


4&. 


79.5 


35. 6 


91-4 


98.7 


FSq(UBA)-'' 
(mall) - 


3179 


62.3 


40. 3 


54. 7 


59.5 


71-2 


86.4 


FSQ(UBB)-'^ 
(mail) 


331 


22.0 


0.0 


3.6 


21.4 


29.4 


100.0 


FSQ(UBA)-^ 
(celephcae) 


U83 


38.6 


0,0 


. 31.6 


38-9 


46.2 


56.3 


?SQ(UBB)-^ 
(celephoae) 


^14 


97.3 


50,0 


100-0 


ICO.O 


100.0 


100-0 


?sq(csA)-'' 

(sail) 


1338 


53.3 


39.5 


52.9 


53.3 


67.5 


81. 1 


FSq(CS3)-'' 
(mail) 


502 


15,5 


0,0 


4.7 


15,3 


25.0 


50.0 


FSq(CSA)-^'' 
(celephoae) 


767 


38,3 


16.7 


30.3 


36.6 


47.5 


72-7 


FSq(CSB)-'' 
(celephoae) 


424 


90.6 


0*0 


100.0 


100.0 


100.0 


100.0 





— The dlscribucloa or recum race for specific Inscrumeacs over projeccs is aoc 
based coasiscencly oa 54 projeccs, since aoc all projeccs would aecessairily have 
eligible staff or scudencs for soae iastrmeacs. The lease aumber of projeccs on 
which the distribution is based is 43 for the D/TQ(B). 



CS group inscrumenc. 
UB group Inacrusieac. 
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artificially inflated in that some information (minimally the student's 
name) was available for all sampled individuals, and thus the form was 
completed and returned in virtually all cases. 

Return rates for UB project staff questionnaires were generally 
acceptable. The lowest return rate (72.9 percent) was realized for project 
instructors. Complete^^^ staff data were avai.l ' ' Fnr ^ly 18 projects 
(one-third of the projects sampled), altho' lects data were 

available for the project director and at u v ^cut of the counse- 

lors and instructors who were sampled. For tlie project by student analyses 
this nonresponse of project staff compounds the loss of student data. 
Indeterminate or missing project staff information preempted effective use 
of the aggregate student data for that project. Weighting adjustments—^ 
for loss of project staff data in the project-based analysis presented in 
Chapter 4 provided an alternate treatment of the problem of staff nonresponse. 

Student questionnaire return rates were also generally acceptable. 
Low return rates were experienced for D/TQ Forms A and B, but these were 
questionnaires mailed (without extensive followup) to those sample members 
who had left school or project and who were, as a result, difficult to 
locate and probably less motivated to respond. A low return rate was also 
experienced for the D/TQ(C) , which was a mail followup instrument for UB 
participants failing to- attend the BSQ(B) group administrations. The group 
toward which this questionnaire was directed had already demonstrated a low 
propensity to respond. The return rates to the mailed PSQ forms was about 
as expected (approximately 60 percent for previous respondents and about 20 
percent for previous nonrespondents) . Response to telephone f ollovmp for 
the FSQ were high, as expected. As noted previously, the return rate for 
the telephone followup for Form A reflects primarily the subsampling (only 
40 percent for both CS and UB groups) and response rates among those sampled 
is actually closer to 95 percent. Total return rates for the FSQ forms, 
irrespective of mode of administration, may be obtained from the entries in 



16 / 

— All sampled staff members responding. 

— ^ See Appendix F for techniques used in adjustment of sampling weights 
to compensate for nonresponse. 
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Table 3,3. Consider, for example, the case of the FSQ(UBA). From Table 
3,3, it can be seen that 62,8 percent responded to the mail survey and that 
among the nonrespondents (37,2 percent) an additional 38,6 percent were 
contacted by telephone. The return rate for the FSQ(UBA) is therefore 
100(,628 + (,386) (.372)) = 77,2%. Return rates for other FSQ forms are: 
FSQ(UBB), 98,3 percent; FSQ(CSA), 74.2 percent; FSQ(CSB) , 92.1 percent. - 

Differences in return between UB and CS were, in general, small as 
seen in Table 3,3, Although not directly ohvi is fr- ^-hle 3,3, complete 
student nonresponse (no available questionnaire data) -jas extremely low, 
only 0.2 percent for UB and 1.7 percent for CS. In other words, some 
questionnaire data were available for 99,8 percent of all UB students 
sampled and 98,3 percent of all CS students sampled. Considering only the 
fall 1974 data, no information was available for 19,8 percent of UB students 
and 21.9 percent of control students. 

There is, as seen in Table 3.3, considerable variation over projects 
in return rates of student questionnaires. Minimum and maximum project 
response rates differ by at least 42 percent (FSQ (CSA) -mail) and at most 
100 percent (FSQ(UBB) -mail) . A more stable estimate of variation in 
project response rates can be obtained by the difference in the third and 
first quartiles of the response rate distributions. Using this index, 
greatest variability among projects is shown for the D/TQ, and the next 
greatest variation is for the mailed forms of the FSQ. The low overall 
return rate for the D/TQ and the differential return rate over projects 
suggests that analysis of these data could easily lead to spurious results, 
and for this reason, no analysis is based exclusively on D/TQ data. 

C. Quality of Item Response (Questionnaire Data) 

While response rates to the instruments define the upper limit of data 
availability, they do not by themselves give an accurate picture of the 
amount of indeterminate data for specific items of information within the 
questionnaires, nor do they indicate the quality of the data that has been 
made available. Substantial amounts of indeterminate data for a given item 
(or set of items) , especially if it is differential with respect to impor- 
tant subgroups of respondents, would indicate a low degree of usefulness of 
the data for analyses, and possible bias in results. 
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The particular characteristic of data quality examined in this sub- 
section are: (1) item nonresponse; (2) logical respcnj^e inconsistencies; 
(3) inconsistent responses within routing patterns; and (4) out of range 
and multiple response. Also considered as an index of data quality for 
analysis purposes is the extent to which data were imputed. Since data 
imputations were performed by reason of nonresponse or multiple response, 
imputations did, in fact, represent questionable original data. To the 
extent that the imputations performed were logically and/or stochastically 
correct, the initial quality of the d has been improved. 

The quality of questionnaire orted in two tables, reflecting 

the two ways of examining the data .f respondents and items. Table 

3.4 gives information as to quality of data by items for each questionnaire 
examined. The entries for this table were determined by computing, for 
each item of a given questionnaire, the proportion of respondents exhibiting 
each of the five categories of questionable data quality. The resultant 
proportions define five frequency distributions (five proportions for each 
item) of item statistics within a given instrument. The minima (MIN) , 
maxima (MAX), and quartiles (Ql, Q2, Q3) of these distributions are reported 
in Table 3.4. Consider, for example, the entries in Table 3.4 for nonre- 
sponse to the D/TQ(C). The tabled entries indicate that there was at least 
one of the 52 items for which there was complete response (minimum nonre- 
sponse of 0.0 percent). For one-fourth of the items (13 of the 52 items) 
nonresponse was 1.8 percent (5 of the 274 respondents) or less. For half 
of the items, nonresponse was 3.3 percent or less, and for only one-fourth 
of the items was nonresponse 10.2 percent or grea.t-^ar. The maximum nonre- 
sponse to any item was 16.8 percent. 

Table 3.5 provides an examination of the same aspects of data quality 
of each questionnaire with the focus shifted to the individual. For each 
respondent > the proportion of questionnaire items exhibiting each of the 
five categories of questionable data quality was computed. The extremes 
and quartiles of these five frequency distributions of respondent statis- 
tics are the entries of Table 3.5. Considering again the entries for 
nonresponse to the D/TQ(C), the tabled entries are now interpreted quite 
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differently. More than half of the 274 respondents responded to all 52 
items of the questionnaire, and three-fourths of the respondents exhibited 
nonresponse of no more than 3.8 percent (2 of 52) of the items. The maximum 
individual nonresponse to items was 55.8 percent (29 of the 52 items). 

As- an aid in summarizing the data in Tables 3.4 and 3.5, the value of 
Q2 may be used as a representative value of the particular data problem for 
a given instrument and the difference between Q3 and Ql may be used as a 
measure of variability. It should be pointed out, however, that certain 
categories^.of questionable data are restricted to limited subsets of 
items. Specifically, imputations are limited to the subset of items for 
which imputations were possible; skip pattern errors are limited to items 
within routing patterns; and logical inconsistencies are limited to those 
items which may generate inconsistent responses. The effect of these 
limitations is that of limiting the percent of total items for which such 
data problems can be observed. This serves to produce some artif actual 
results in terms of: (1) limiting, from above, the tabled entries for 
these categories in Table 3.5, and (2) generating a positive skew for the 
distribution over items of the percentages reported in Table p. 4. Since 
the limitations are somewhat different: for each instrument, comparison of 
these categories over instruments may be misleading. 

From the values of Q2 in Table 3.4, it can be seen that skip pattern 
error and nonresponse represent the largest data problems and that such 
data problems were. greatest for the D/TQ instruments. Median proportions 
of imputations, indeterminate data (multiple answers and out of range 
responses), and logical inconsistencies were very low for all question- 
naires. It can further be observed from the results presented in Table 3.4 
that some items generated more data problems than others within particular 
categories. This may be observed from comparison of the Ql and Q3 values 
(or more dramatically by comparison of the minimum and maximum values) . 
Previously specified artifactual differences are likely present for three 
of the data quality categories. For item nonresponse, however, such com- 
parisons are meaningful. The most variable item nonresponse is observed 
for the staff questionnaires and for the D/TQ instruments. For some staff 
instruments nonresponse to specific items took the full range from 0 percent 
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for some items to 100 percent for others. From Table 3.4 it is obvious 
that some questionnaire items had sufficiently questionable quality to 
exclude them from any analysis. 

Table 3.5 indicates data quality of the individual respondent ques- 
tionnaires. Examining the quartiles, the table indicates reasonably good 
data with the exception of the staff questionnaires for which over half the 
questionnaires returned were 17 percent or more incomplete. There was 
individual variation in the quality of returned questionnaires, as would be 
expected. This can be observed in Table 3.5 by comparison of Q3 and Ql (or 
maxima and minima) for a particular questionnaire and data quality category. 
Some individuals exhibited considerable difficulty with skip patterns (see 
maximum value), especially with the D/TQ and FSQ instruments (both of which 
contained an extremely complex routing pattern) . For each questionnaire 
there were individuals who failed to respond to a large proportion of the 
items. 

In summary, the picture, of data quality pres:ented in Tables 3.4 and 

3.5 is not such as to present serious problem^ for analysis. The proportion 

of individuals with large amounts of questionable data is reasonably small 

and the greatest problems of data quality seem to lie in a few specific 

items. Omitting such items restricts analysis to those items for which 

IS / 

data quality is within reasonable limits. 

D. Quality of Data (Other Instruments) 

Data from sources other than questionnaires (PRV, SARF, STF, and HSCR) 
were theoretically available on all students (except in the case of school 
or project refusals), and plans called for considerable use of such irsfor- 
mation, particularly where respondent-supplied information was missing. In 
actuality, some items of information were not available for all students. 
Unavailability, due to difficulties in record keeping at some UB projects 
or limited access to high school records (some high schools refused t^ 
divulge any student transcript information), led to gaps in STF inf or=:ation. 
Procedures to expedite return of PRV forms, in order to allow timely 



— In subsequent chij^rters , analyses which are restricted due to data 
quality of particular iLnems will be specified. 
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sampling of students, led to incomplete PRV information from some projects.. 
Similar procedures to expedite return of HSCR forms, coupled with inability 
or refusal on the part of high school teachers to provide all requested 
information, led to incomplete data for that form. Finally, individual 
differences in the conscientiousness of the Survey Administrators in docu- 
menting the SAEI led to differentially informative SARF information. 

The use of data items from these other instruments did, however, serve 
to augment the student-supplied questionnaire responses in analyses. 
Complete data availability for all students, even with the info^ i' ^ 
from these other forms, was neither expected nor realized. These other 
f j::r:zd did provide^ besides the additional information, a natural vehicle 
fox reliability studies which are conside2::ed in sections IV and V below. 

IV. REDUCTION OF STUDENT DATA FOR ANALXSIS AND 
FURTHER LOSS OF EZDDENT DATA 



As specified previously, only a sirbset of data elements were available 
for the entire student group due to the. nature of data collection opera- 
tions. This section presents a brief sxunmary of the operations performed 

and discrepancies encountered in reducing questionnaire data to this common 

19/ 

set of data eler^ents. — After resolution of the common data elements, the 
resultant data were examined for possible^ioiisclassif ication of students in 
respect to the defined sampling frame- 

A- Creation of Student Master File and Inter-Instrument Inconsistencies 
The file containing the common variables for all students was desig- 
nated as the student Master File. This file contained 22 measures on each 
student, obtained from several sources of student data. The elements of 
the file were: (1) sex; (2) race; (3) age; (4) poverty status index; (5) 
extent of UB participation; (6) academic risk index; (7) through (9) high 

197 ' 

— IFor a more detailed account of this procedure, see Appendix E- 



116 



school ( HS) enrollment status at each of three points in time, fall 1973, 

spring 1974, and fall 1974; (10) through (12) HS grade level at the same 

three poiuts in time; (13) through (15) highest grade completed at the same 

three points in time; (16) through (18) postsecondary education (PSE) 

status at the same three points in time; (19) through (20) HS equivalanc - 

program ( HEP) status at each of two points in tirae> ing 1974 and fau-i 

1974; and (21) through (22) work status in spring 19/4 and fall 1974. 

1 file was created by abstracting the appropriate information from 

each of the individual student questionnaire files and then obtoS.tning the 

20 / 

particular Master File data item from the "most valid" — - source available. 
The large manber of student instruments was valuaole in many c^es, in that 
data mising from questionnaire responses could be supplemented: from other 
instrumenizs. On the other hand, the presence of replicate information 
created^rzne possibility of inter-instrument (inter-source) disagreement and 
thus an^mconsistency of the data element. Specific attention is directed 
to these-_ziscrepancies in Section V below; however, due to the importance 
of the MHister File in subsequent analyses of student outcomes, the overall 
quality ::zf these data is presented here. The specific data problems present 
in the Master File, after extensive editing and imputation, are given in 
Table 3.6. Discounting the fact that data were not available during fall 
1974 for those not selected for telephone follow-up and the artifactually 
inflated values noted in Table 3.6, the quality of the Master File data is 
well within acceptable limits. 

B. Further Loss of Student Data 

On examining the edited Master File, certain responses were 
uncovered which indicated inappropriate classification of students within 
the original sampling frame (some misclassif ication cases had already been 
determined at the time of BSQ administration — see subsection III. A of this 



20/ 

Source of information could have been student, UB staff member, HS 

staff niember, parent, spouse, friend, etc.; and information could have 
been obtained by group questionnaire administration, mail, or telephone. 
These factors were considered in determining "most valid" source — see 
Appendix E for specifications. 
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Table 3,6 

EXTE^n: OF UNAVAIIABLE Al^O INCONSISTENT DATA IN STUDEJIT MASTER FILE 



Master File 
Variable 



Data Quality Classification- ^ _ 



On.iy Inconsistent 
Data Avail able^^ 



Sax 

Race 

Age 

Poverty Status 

Extent of UB Participation 

Academic Risk Status 

H. S. Enrollment (Fall 73) 

H. S. Enrollment (Spring 74) 

H. S. Enrollment (Fall 74) 



H. S. Grade Level (Fall 73)-^^ ' 
H. S. Grade Level (Spring 74)—^ 
H. S. Grade Level (Fall 74)-^^ 
Highest Grade Completad (Fall 73) 
Highest Grade Completed (Spring; 74) 
Highest Grade Ccayleted (Fail 74) 
PSE Status (FaU 73> 
FS£ Status (Spring 74) 
PSE Status (FaU 74) 
HEP Status (SptinJt 74) 
HEP Stacus (Fail 74) 
Work Status (Spring 74) 
Work Status (Fall 74) 



liable Data 
"h Inter- 
ment . 
:iiacencles^ 



2.3 
2.7 
9-7 

5.2 

1.1 

0,0 

i.O 
25. 

0.2 

5.7 
60. 7^/ 

0.1 

0.3 
22. 

2.9 

1.0 

2i.ii/ 

4.0 
28. 

78.4i/ 



26.4 



d/ 



O.OZ 

0.0 

0.0 

0.0 

0.0 

0.0 

0.6 

0.1 

0.7 

1.5 

1.3 

0.0 

1.1 

1.2 

2.1 

0.0 

0.1 

0.1 

0.2 

0.2 

0.1 

0.0 



O.OZ 

0.8 

0,1 

0.1 

3.7 

0.1 

0,1 

0,6 

0.1 

0,7 

0.7 

0.0 

0.7 

0.3 

0.1 

0.0 

0.0 

0.0 

0.1 

0.1 

0.1 

0.0 



— ^ Percentages given are based on 6^050 students after editing and Imputation. 

Data were available from one or more sources, but all these available data had been 
previously determined as Inconsistent within the particular source instruments. 

c/ 

— ' Data were available from more than one source, and while the data were 
consistent within instruments Csources). they were inconsistent among instruments. 

Missing data percentages for the fall 1974 time point are high due Co Che 
fact that sub-sampling for follow-up fall 1974 data collection activities excluded 
about one-flfrh of the sample. 

e/ 

— ' Missing data percentages are Inflated due to iriie tact that H. S. grade level 
was Indeten: 'oate for students no longer in high sxihool. 

The missing data pev^zentage at this time point is Inflated due the fact that 
questions related to vork were not posed on the 3SQ. Thus, for 3SQ respondents 
(a largs portion of the total group) , no data are available relating to this 
variable at this time point. 
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chapter). There were three categories of misclassif ication noted: (1) 
those students classified as UB participants who stated nonmembership (or 
nonpart^.cipation) in UB at the time point defined by the sampling frame 
(fall 1973); (2) those students classified as in the CS group in fall 1973 
who subsequently reported UB participation; and (3) those students (both UB 
and CS) who reported they were either out of high school (graduated or 
otherwise) or at inanjpropriate grade levels (grade 9 or less) in fall 1973, 
as,. required by the sampling frame. 

There were many members of the UB group who reported dates of first 
and/or last participation in UB that conflicted with their classification 
as being in the projiect during September or October 1973 (the time point 
specified for the sampling frame) . Allowing a response error of two months 
as "within reason,'' 229 such conflicts still remain. Specifically, 36 
students reported first participating in UB during or after January 1974, 
160 students reported last participation in UB during or before June 1973, 
and 33 students stated they were not in any UB project during fall 1973 — 
yet all of these students had been specified by project staff (either 
implicitly or explicitly) as project members during September or October of 
1973. A total of 173 students in the CS group stated that they had partici- 
pated in UB. This type of misclassif ication had been expected considering 
(1) that the CS student group was selected from high schools in which UB 
recruited, and (2) that oversampling of poverty level students who were 
academic risks was performed. These students were identified through their 
response to a question regarding UB participation on the BSQ(A) or on the 
FSQ which were desigired to discover this form of misclassif ication. Finally, 
36 students were identified to be in a grade level less than ten during the 
fall of 1975, and four students not in school at all during this period. 
For analysis purposes, these students were not considered and the total 
student sample size was reduced to a total of 5,608. 

V. DATA RELIABILITY 

Previous examinatnion of item quality within each individual question- 
naire (Section III) arnL within the Master File (Section IV) may serve as an 
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indication of the internal consistency of responses and reliability of the 

data; however, due to the number of various instruments, studies of the 

reliability of certain key items were possible. Specifically examined was 

the consistency of student questionnaire data when compared to data col- 

21/ 

lected from a source other than the student. — Tables 3.7 and 3.8 provide 
reliability information in the form of proportion of agreement between 
student reports and project or school reports.—^ 

While proportion of agreement between two sources of data is a rela- 
tively crude index of reliability which does not take into account baseline 
response rates for the various categories of response, it is considered to 
be useful for the categorical data considered here. OnLy- cases with deter- 
minate data (not previously found to be inconsistent or otherwise indeter- 
minate) for both data sources were used in determining percent agreements. 
The percent agreements between UB student responses to questionnaire items 
and the responses of project personnel (or data of record collected from 
project files), as reported on other instruments, are given in Table 3.7 
for selected variables common to both instruments. Analogous percent 
agreements between CS student responses and high school staff responses (or 
data of record from high school files) are given in Table 3.8. Also reported 
in Tables 3.7 and 3.8 are maximiim numbers of students on which a given 
reliability index could have been computed (i.e., numbers of students 
eligible for completion of the various student questionriaires) and the 
number of cases on which the reported reliabilility index was actually 
based (i.e., numbers of students with determinate data available from both 
sources). The difference in these two numbers gives the number of students 
for whom one or both of the data sources were indeterminate. 



'21/ ' ■ 

— These analyses were produced routinely during the preparation of the 
Master File, described in the previous section. 

22/ 

For the UB group, information concerning a particular student was 
supplied directly or indirectly by the project staff as reflected on the 
PRV, STF, or SARF. For the CS group, this information was provided by 
the high school staff as reflected on the HSCR, STF, or SARF. 
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ERIC 



The pattern of response agreement as shown in Tables 3.7 and 3.8 is 
quite similar for both the UB and CS groups. Specifically, agreement as to 
high school enrollment status is greater for the fall 1973 reference point 
than for the spring 1974 reference point, while agreement as to high school 
grade level is greater for the spring 1974 reference point than the fall 
1973 reference point. Moreover, agreement for the BSQ eligible groups (and 
the D/TQ(C) eligibles within the UB group) is, in general, higher than for 
those not eligible for the BSQ (D/TQ(A or B) eligibles) or for those students 
who responded to none of the spring 1974 instruments or followups. 

No attempt will be made to explain the observed patterns of response 
agreement due to the fact that for some instruments the number of cases on 
which the proportions are based is small in both an absolute sense and/or 
relative to the number of eligibles. It should be pointed out, however, 
that the reliability indices could be artif actual in some respects: namely, 
(a) data were collected at different points in time and in some cases were 
retrospective, (b) the base response for fall 1973 high school enrollment 
status was extremely high for the category "in high school" (for the CS 
group this was 100 percent by definition), and (c) high school grade level 
was indeterminate for students classified as out of high school so that 
disagreement as to enrollment status precluded comparison of grade level 
(since at least one of the data source variables would then be indeterminate). 

In all, the actual rates of agreement are not too discouraging. 
Considering those comparisons for which a substantial proportion of eligible 
student data could be used in determining source consistency, proportion of 
agreement rarely drops below .8. But even an agreement rate of better than 
.9 would cast some doubt on the reliability of the data when one considers 
that the variables being compared here are reports of relatively concrete 
simple states of nature. This would suggest that reliability of more 
subjective data would be considerably lower. 

Given an empirical lack of perfect agreement, ^phe reasons for this 
lack of agreement between students, on the one hand, and projects and 
schools, on the other, is a matter of speculation. Possible explanations 
could range from data entry (coding and keypunch) error to deliberate 
falsification of responses. Regardless of the reason, the inconsistencies 
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observed should be sufficient to warn the reader of possible errors in 
subsequent analyses. Although data with observed inconsistencies were not 
used in subsequent analyses, not all analysis variables could be compared 
across sources due to lack of commonality in the various instruments. For 
those variables not amenable to inconsistency checks, there is no reason to 
suspect that reliability would be greater than that reported here. 

Some insight may also be gained into the reliability and validity of 
the data collected in respect to UB staff questionnaires. During some site 
visitations, staff responses to certain questionnaire items were examined 
in face-to-face interviews with the responding staff members. While no 
statistical evidence is presented, it was reported in many instances that 
questionnaire responses did not agree with reality. Particularly suspect 
were the responses to fiscal questions which formed part of the data base 
for the cost analysis (see Chapter 5) , 

VI. DIFFERENCES BETWEEN RESPONDEl^T SUBGROUPS 

As specified in Chapter 2, student subgroups, defined by response to 
different instruments, provide a large nximber of data sets, the elements of 
which differ, sometimes markedly. Further, as indicated in Section I of 
this chapter, certain analysis questions can be addressed only by an exami- 
nation of one of these exclusive data sets (e.g., many of the analysis 
questions are directed to data obtained exclusively from respondents to the 
BSQ) . Analyses were therefore conducted to provide the reader with some 
insight into possible hlaa in subsequent subgroup analyses. Such biases 
could be brought about by the high likelihood that subgroups, defined by 
completion of particular student questionnaires, are not representative of 
the entire UB or CS population. 

This section presents the results of the analyses of respondent subgroup 
differences. This set of analyses was conducted using a subset of the Master 
File variables (described in Section IV of this chapter) and using sampling 
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weights. That is, each student's responses were weighted by the inverse of 

the probability of selecting that student. Such a procedure produces 

23/ 

unbiased estimates — of subpopulation values when sampling units have 

unequal probabilities of selection. Also, for this set of analyses, stand- 

^24/ , , 

ard errors — were computed and are presented. 

A. Comparison of Respondents and Nonrespondents in the BSQ Eligible 
Subgroup 

The first difference examined is that between UB students responding 
to the various administrations of the BSC, and those who were eligible for 
BSQ administration but who only responded to the short followup instrument, 
the D/TQ(C). Theoretically, the latter group should have been in the BSQ 
data base, but for various reasons did not participate in any of the ini- 
tial or makeup administrations of the BSQ. Any differences found between 
these groups should reflect the direction and magnitude of differences 
between respondents and nonrespondents in the BSQ eligible group. The 

result of the comparison is given in Table 3,9. As seen from Table 3.9, 

25 / 

there are few statistically significant — differences between the two 
subgroups. The variables yielding significant differences are age and 
extent of UB participation. Since the percentage of indeterminate response 
to extent of UB participation is also significantly different, other 
differences for this variable are difficult to evaluate; however, there is 



23/ 

The term unbiased is used here in a statistical sense. An unbiased 
estimate of some population value (parameter) is defined as one obtained 
from an estimator with expected value equal to the parameter value. Since 
only a sample from the population is used to estimate the population value, 
the value of the estimate will vary from one sample to another. If the 
mean value of the estimates obtainable from all possible samples is the 
same as the population value being estimated, then the estimate is unbiased, 

24/ 

— The standard error of an estimate (or differences between estimates) 
is a measure of the extent to which the estimate (or difference) would 
fluctuate between different samples. More precisely, the standard error 
of an estimate is the estimated standard deviation of the sampling distri- 
bution of the estimator used. 

25/ 

— Statistical significance is defined here as differences greater than 
two standard errors of difference. Such differences would occur less 
tha;n 5 times in 100 by chance sampling error if, in fact, there was 

no true difference. 
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Table 3.9 



DIFEE3E3CES BETWEEN BSQ(B) RESPONDENTS AND 
3/05(0 RESPONDENTS ON SELECTED VARIABLES 





1 

i.5leCTcase 

i 2 ir^r iable JZ^Ke^ary 


. a/ 


SSrandard 
ionror <xf 
Dl£f erence 


Sf.vlB) 


D/TQ(C) 








Yrs. 

C .3% 


J.7.3 Yrs, ' D.l Yrs.. ^ 
1.5% 0.8% 


Sex t^l* 

Idzli t ennina t e— 


-4-0.« 8 
56.2 
0.0 


40.6 i 4.2 
59.4 j 4.2 
0.0 


Race 


ISlr^tie 

Ii::zie t ennina t e— 


64.6 
_5.6 
^3.0 
0.8 


57.1 
21.0 
19.7 
2.2 


4.6 
3.8 
4.2 

L..0 


Poverty 


Po^-erty Level 
Non Poverty Leyel 
Indeterminate-* 


65.8 
22.4 
11.8 


64.1 
22.6 
13.4 


3.5 
d/ 
1.8 


Grade Level 
Fall 1973 


10th Grade 

11th Grade 

12th Grade , 
c / 

Inde t ermina te— 


14.6 
40.0 
44.2 
1.1 


11.5 
37.6 
47.3 
3.6 


2.0 
4.2 
4.6 
1.6 


Grade Level 
Spring 1974 


10th Grade 

Llth Grade 

12th Grade , 
c/ 

Ind e t ermina te— 


12.7 
39.8 
45.0 
2.5 


8.3 
37.4 
48.0 

6.3 


2.5 
3.8 
4.7 
1.6 


H.S. Enrollment 
Spring 1974 


In High School 
Graduated from 

High School 
Out of H.S . , 

Not Graduated 
Indeterminate-^ 


98.2 

0.3 

0.9 
0.6 


96.3 

0.0 

1.4 
2.3 


1.2 

1/ 

d/ 
1.0 


Extent of 
Upward Bound 
Participation 


Less than 1 Year 

1-2 Years 

2 or More Years 

Indeterminate— 


50.0 
27.0 
13.2 
9.8 


51.3 
13.2 
5.8 
29.7 


3. -9 
3.3 
2.0 
4.0 













— Mean age is given in years, all other entries are percentages. All 
values were computed using weighted data adjusted for instrument nonresponse. 

Based on determinate responses only. 

c/ 

— Indeterminate responses represents item nonresponse, inconsistent and 
multiple responses. 

Standard errors were not computed for absolute differences less than 1%. 
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an indicaticn that the ESQ resiv^vTidH— group mar:- be a biased representation 
of the BSQ eligible group Iv, t}^rx tfc^ are younger and have participated in 
UB fox a longer pericd of t-lr , 

B. Comparison of the BSC jy.;. le^ jubgroup and the Subgroup r~ BSQ 
Ineligibles 

Another possible compari-.cr. cmr^riins the difference betwee:. BSQ 
respondents and those students -' :\ vriginal sample who were nc longer at 

the same project or school at ^ ;e tz-ti^.- j± BSQ admfeiistration (and thus not 
eligible for BSQ administratitf)^!..- [u-^ latter subgroup was the D/TQ (Porms 
A and B) eligible subgroup.^ ^h^i^r :^ recalled, however, iii__xnterpreting 
the result of this analysis tr 'r- '-^ ^'.c^ial comparison made was that between 
the D/TQ (Forms A and B) respc aag ^kk- BSQ respondents and tha:t response 
rates for these D/TQ forms wezs ext;rtiii^eiy low. Thus, the D/TQ respondents 
were not necessarily represent: -i:LVs cjz -zhe entire D/TQ eligible group. 
Further, it has been shorn pre- :ous^^ rhat within the UB group the BSQ 
respondent group was not comple ^presentative of the BSQ eligible 
group . 

Table 3.10 presents the results cf these comparisons for both the UB 
group and the CS group. Thera arss numerous statistically significant 
differences between the two reH^rcr/den::: subgroups within both the CS and UB 
groups. As expected, the D/TQ r::esn)ot:idents differed from the BSQ respondents 
(for both UB and CS) in terms o±' high school enrollment status in spring 
1974. The D/TQ respondent subgraupH rjncTSsd proportionally greater numbers 
who had dropped out of school (tins :i±i:ding woirld still hold even if all 
indeterminate responses in the BSC -i^^j cmdent scmgroup were assumed to be 
dropouts and all indeterminate rsspcnffiss in the D/TQ respondent subgroup 
were assumed to be still in high school). Further, the D/TQ respondent 
subgroup (both UB and CS) was significantly older than the BSQ respondent 
subgroup (which could easily be related to the fact that there were greater 
numbers of high school dropouts) . 

All other variables showing: sx^gxrifxcant differences between the respon- 
dent subgroups within the CS grotjp veare attenuated by differing proportions 
of ♦ indeterminate responst^s. Fo:f *:he UB group, other statistically signifi- 
cant differences between the twc res-pondent subgroups were also observed. 



Table 3.10 

DIrFERHXCES BT^^EEN 3SQ ST^POCTENTS AND D/TQ RESPOSDE:^ ON SELECTED VARIABLES 



Variable 


Response 
Cace^orv 


' Upward Bound ' Comparismr. 3: „.;.i2r-ts 


Weichted Percent— » 


Srandard 
Error of 
Difference 


Weighted Perce=r^ _ 


Error siz ! 
_^lf f erersES- 


3SQC3) D/TQ(3) 


3SQ(A) D/TQ 


Age 


Mean Age-^^ 
Indecerrd.nace^ 


16.3 Yrs. 17.4 irs. 
0.3Z 0.6.^ 


0.1 Yrs. 
d/ 


16.4 Yrs. 17.2 
O.IZ o.ot 


0.2 ^rs. 
d/ 


Sex 


Male 
Female 

Inde cerrrina ce^ 


43.3 32.1 
56.2 67.9 
O.O 0.0 


5.7 
5.7 

d/ 


54.3 41.? j 
45.6 58.1 ' 
0.1 0.0 


9.2% 
9.2 

d/ 


Race 


Black 
IChice 
ather 

^decenrinat^^ 


64.5 52.1 

16.6 18.2 
18.0 26.6 

0.3 3.1 


7.6 
3.6 
7.0 
1.7 


24.6 31.1 11.0 
60.8 44.9 11.2 
12.8 22.8 7.6 
1.8 1.1 d/ 


Poverty 


Poverty -LeveL 
Son Poverty I-gyal 
Indecerjina te- 


65.8 72.3 
2Z-4 23.4 
11-8 4.4 


5.5 
d/ 

27o 


32.9 48.4 9.4 
65.4 51.6 9.0 
1.7 0.0 0.8 


1 

H.b. braae Level 
Fall 1973 


lOtn Grade 
11th Grade 
IL2th Grade 
Indetenaina te— 


14.6 11.8 
40.0 30.4 
44.2 53.4 
1.1. 4.4 


4.8 
5.5 
6.1 
2.2 


37.0 34.4 10.1 

33.4 36.6 6.7 

28.5 29.0 d/ 
1.1 0.0 0.3 


H.S. Grade Level 
Spring 1974 


10 ch Grade 
11th Grade 
12th Grade 
Inde terminate— 


12.7 3.3 
39.3 25.7 
45.0 36.6 
2.5 29.4 


4.0 
5.0 
5.8 
5.9 


36.7 24.-5 9.2 
33.6 15.0 5.3 I 
28.5 4.7 2.6 
1.2 55.3 9.1 ; 


H.S. Earollmenc 
Spring 1974 


la High School 
Graduated frO!s 

High School 
Out of H.S., 

Not Graduate^ 
Indeterminate— 


98.2 70.6 

0.3 2.6 

0,9 17.9 
0.6 8.9 


5.9 

1.5 

5.4 
2.4 


99.9 44.2 
0.0 7.1 

0.0 44.7 
0.1 4.1 


9.1 J 
4.6 

8.9 

2.6 


Excent of 
Upward Bound 
?arcicipacion 


None 

Less than 1 Year 
1-2 Years 
2 or More Year^ 
Inde teminate— 


50.0 53.1 
27.0 12.5 
13.2 0.0 
9. a 34.4 


5.0 
2.8 

1.8 
3.5 


100.0 100.0 

















— Mean age is gl-'/en in years, all other entries are percentages. All values were computed using weighted 
data adjusted for instrument nonresponse. 



Based on determinate responses only. 

Indeterminate responses represents item nonresponse^ inconsistent and multiple responses. 
Standard errors were not computed for absolute differences less than 1%. 
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Notably, the 3SQ -espcrn.- ^nt subgroup had a ^rgtar prDpcrttlcn of maies. 

G ther sigtiif icanc dlf f-^rance^ are atrtenuared .:i ^:h diff &s:3m::es in proporrion 

of indeterminate l aspe-ises. 

In all, many ci t^e differences observec ^tweeiz BSiC- aad D/TQ respond- 
ent subgroups (within dS and JB groups) coulc, expanded: (or related to 
these expectations) dii=^- to rbss fact trmt the /TQ subgro-ps contained, by 
definition, more high ._nhaQl_ dropouts-, Never::.:-^less^ ziie groups do differ 
on important variables, and ^ should x>e realljzed in .^TCTsequent exaniinatic?:is 
of ESQ data that the s^dzdenns providing these data ar^e not: representatiT7?e 
of the entire population of UB or CS students defined by ths initial sanpling- 
To the extent, however., thsit rhese subgroinps differenrss sre similar 
within the UB and CS gr-oup^: (and this seems to -a the case.), greater 
credence can be placed on comparisons between U2 and CS BSQ respondent 
data. 

C. Comparison of Respondents and Nonrespondents to All Spring 1974 
Questionnaires 

Another comparisoir of interest between respondent subgroups is that 
between respondents ami nonres^jondents to spring 1974 data collection! 
efforts. As may be recalled, respondents to the spriir§ 1974 data collection 
were eligiblisi for the FSQ(A) instruments while nonrespondents received the 
FSQ(B) instrnmients. The actual comparison made was between the FSQ(A) 
eligible grovrp and the FSQ(B) respondents.—^ Since response rates ^ere so 
high for the FSQ(B) eligible group (recall that all FSQ(B) eligibles were 
telephoned as a f ollowup) , the respondents can be assnmedi as quite repre- 
sentative of the total eligible group. H^Dreover, since ^::he BSQ respondent 
group made up such a. large p^ropziirtion of -he spring 1974 respondents, this 
analysis will reflect, pcimsrdly, differences between BSQ respondents and 
spring 1974 nonresponden:^. 

The results of this- analysis are ;rr:s=^ntHd in Table 3.11. As can be 
seen, these two respond^t sub^oups /'iizrxh CS and UB) d±ffer significantly 
on all eight of the varrables considerrad. For "vrr-h the UB and CS group.,, 
the I*SQ(A) eligible suhgrour is younger than tne 5^SQ(B) rsespondent subgroup, 
although this difference- is somewhat attenuated: by the feet that the 



26/ 

— For FSQ(B) nonrespondents, no questionnaire data of any kind were 
obtained. inn 
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rSQ( aZSraiaZSTS Oi? selected ViJOlABUiS 













Uovarc Bound 




Conparison Students 






a/ 

i-e-rcentaze— 


5t3 !jc ,-ird 


a/ 

Percenraze— 


Standard 


Variable 


Reunions e 


*^Q(«-) b/ 


FS0(3) 


irrcr of 
Hifrrr'T^ace 


Eliffibles-' 


FS0C3) 


Error of 
Difference 
















Age 


Indecerainare^ 




17.3 Yrs. 
3.JX 


Yrs. 


16.5 Yrs. 
O.IZ 


17.3 Yrs. 
16.42 


0.1 Yrs. 
3.72 


Sex 


Male 
renal . 

IndeEsrainace^^' | 




51.5 jj -1^5 
48.7 i! 

0.0 .1 y 


54.0 
45.3 
0.1 


51.5 
46.1 
2,4 


3.9 
e/ 
0.9 


Race 


Bla^:< 
Ocrior 

In d e e r aina c ■■ 




45.1 ' 

24.0 
28.7 
2 


■V.5 
-..0 
.3 
-.3 


24.8 
60.5 
13.0 
1.8 


41.6 
36.1 
8.4 
13-9 


4.0 

5.7 
3.2 
3.0 


Poverty 


Poverty Level 
Non Poverty La^el 
lad e 1 2 rmina c 


65.5 
2Z.5 
11.6 


£'3.4 
,^3.2 
ZD:4 


-.4 


33.3 
65.0 
1.7 


40«3 
46.7 
13.0 


3.2 
5.0 
5 . 0 


Grade Levej. 
?aU L973 


10 ch Grade 
11th Grade 
12th Grade 
Ind e cer^nxaa t 


l-i^.3 
33.5 
4-4 . '* 
1.- 


14.6 
.26.3 
43.5 
LO.l 


Z.5 

2..1 
4 


36.9 
33.5 
28.5 


39.7 
25.8 
31.3 
2.3 


4.1 
3.1 
4.5 
0.9 


Grade Level 
oprln^ 1974 


la-h Grade 
" Grade 
12 th. Grade 

c - 

Inde t erainace— 


• •> 

44^.9 
3^3 


13.2 
23".l 
43.0 
20.7 


e/ 
- . 4 

:.9 
-> . ^ 


36.4 
33.2 
28.0 
2.5 


29.4 
16.9 
27.1 
26.6. 


4.2 
2.7 

e/ 
3.2 


H.S. Earoilment 
Spring 1974 


In High -icir'Ofciiw 

Graduates i:r.:^c: 

High S.=t3=^ 

Out of 

^'ot Gr;nrt::rated 
- . _ !i/ 
tnde cer=Eare~ 


97.,0 

0..J 

1.6 
1.0 


=a.3 

1.8 

U.5 
3.3 


2.1 

0. 3 

1.7 

1. a 


98.6 

0. 2 

1. C 
0.1 


74.9 

1.9 

19.9 
3.3 


3.3 
0.3 
3.1 

0.9 \ 


SxtrgTic of 
Up-war^ Bound 
Parc=clpacion 


None 

Liss chat 1 tear 

1—— TaaST- 

2 or i*Qr£.^i*«j£ 


jQ-2 
-35.4 
12.1 
12.3 


^:36 .6 

JJ.2 
7.0 
9.1 


1.9 
.1.6 
1.7 
1.5 


100. u 


100.0 



















— 'Sgaa age is givsn r'- yssrsv -s-^^^rher antriiis pet^enxag^:-*. AlIL values were computed using weighted 
data 5a5ju3Ced for irzsrrunisnt:: ■ffirriteffp.cnise . 



r^Q(A) eligiil^s were rrrms^ ■■ s.p:dq:its :=ho hssi- .rprert^-ii-v^-L- responded to either BSQ or D/TQ instruments. 
Based on dec^ninate respgnr^'r^'Traly . 

i=ideterziiaac« responses ^.air r:«isgi i:r-? icsa nainresponse inconsxitent and multiple responses. 
:Srandard errors were notr nswctuted for absol..rr.e di rferencas Less than 1% . 
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proper tloa c indetenaiiaate responses is graate in rhe FSQ>11.) subgroia* 
Further, ther::^ are prop'ortionataly more el-^ventr graders (bc~h in fail 1973 
and spr-ing 1- 74 classifications) in the FSO(A) s^group. Ag^u, howevar, 
these -iffer:S3ces are confounded by differences i-n proportions of darenni- 
nate respons-es. The FSQ(A) subgroups also have trrcriGrtionately fewar aigb 
school dropoizrs, and although differences exist _a TT^portian of Indetermi- 
nate responses, the observed differences wou^d -risr regardless of distri- 
bution of the indeterminate responses among ::he czh^^s enroUjmsnt status 
categories. 

For the UB group, respondents to the sprin^g 197^ data collection 
efforts tend to have proTrartionately larger ziumberrs of females than non- 
respondents. Further, in. terms of extent of UB p^ticipation, t^ie FSQ(A) 
subgrotxp (spring 1974 resipmdents) has participated longer in the UB 
program. 

Two intsresting reversals afipear in subi^,rour lifferences: wltihin the 
UB and CS group in regards to the variables rars and poverrr^ status. 
Within UB, the FSQ(A.) eligible group had proportinmately fewer Twhite 
students and mor^ black and "other" studenrs than did FSQ(B) ^spondents. 
The opposite situation existed for the CS rroup. Similarly, the 3SQ(A) 
subgroup had proportionately larger numbers cf po^t^rty level students 
within the UB group, but proper ti:ai>-arely fr^/er poverty level st:udenrts 
within the CS group. This revi-rsaJ. iias soz ^ rt^ther obvious implications 
for subsequent analyses.. Specifically, wher ..cmparing response of the UB 
and CS groups based exclusi'-ely on spring anesttiotmalre dat^ (e.g.... 

BSQ) , one is comparing two simgroups of tois 'j^cincaled p:ii}.ulations ■ rrh--r ar^ 
(1) not representative of ths .trft^a s^^i^, r-nd (2) Ijlased in orrposite 
directioris for at least two "laxdLaiis -rnisid -rec:. 

D« Comparison of Respoirdeats ;and l^Tonriasprnadents to the FSQ 

The final consideration or cempariabillty of respondent subgroups is 
that of possible differences between FSQ (A) respondents and FSQ(A> non- 
respondents. It may be recalled tnat only a subsample of the original ncr::- 
respondsnts to the FSQ(A) mailing '-^Tere selected for telephone followTnip. .£5 
such, considerably less than cocnplcte C2S3onse w^as obtained for the tall 
1974 data collection periisiL. 11 1>^. possljDle (sine- data was collected rr 
all FSQ(A) eligibles during tiie sprlrrg 1974 collecrion period) to deterrrine 
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the extent to which the respondent subgrciip was or vas not: represemtative 
of the total group. 

Table 3.12 presents the results of this final comir^lsnn. For r:h& ZS 
group only two statistically significajit differences we^e observed, notably, 
the respondent smbgroup was composed of g^reater proport::;^r:S of feinales and 
white students. For the UB group, the picture was somevliHt di:Sfereiit, 
There ware ipropcrtionately greater numbers q± eleventh prad^rs among the 
FSQ(A) respond^c subgroup than among the ncnrespondent^ * and respoEidenr::s 
had typically paxticxpated in the UB prog^rsm^ for a short^^^^ period of time. 
Lika the CS group, the UB group had prcrpxaxtaonately more i^naies in the 
respondetiit subgroup. The UB respondent s-inbgroup also coni-^ned propi^rtion- 
ately larger numbers of poverty level s-cuga=ats^ and (with .:aarginal signifi- 
cance) larger proportions of white stuzisnts and youmger students. 

These observed differences suggest,, of ccnrse, that fall 1974 dac^i ^^e: 
available for a subset of students (in both UE and CS groivurs) rhat is nc::: 
completely represantative of the original saiaple. This -iacij: should be kept 
in mind when interpreting results based am fall 1974 dats... 

E. Implicataons of Subgroup Dafferences 

In general. Tables 3.9 thxxiugh 3.12 indii-iaxe tbs: pc-5£:i^3il±ty" of stsnH^ 
biases in the analyses* Diff ex^^ncss cEo exis;t^ 3nd rresnZ^rzjriig axzaljs^^ 
interpretation of student dsta musr be c end m:: red carrBrulZi^ with the iros^^ 
bility of this bias in mind. The eftecta nalanci^g weight. ai±jistHsmts 

for nonr espouse and subsampling (see Chap.tH: 7) red'ice liif^rences bsnrweiio. 
UB and CS groups, but do not conipletely dl:a:c.armt difiersnc^ between lilB 
respondents to different UB quasctionnaires jir CS respcon^iem^ to differem 
CS instnments. 

The differences examined in this sec::t:ian will i^mcnrrg-nt ccnmsi^^r ~ 
ations only when data from the specifii:^ . :j;3iirS: st:;bgrrT:urp£= are snaZ Tzen. 
and then the major consideration will. rha^i: of rgenen^ -•. r:??bi:lit:>'^ of di^ 
analysis results. The exact nature of aisaljrsxs Mias csni neat be state-d 
direcrly; rather, it will depend on tira. interxrelsniioisirips of the var-iaSiles 
on which subgroups show differences and o^her varxab-Lss sa-.X)sequent:ly ccrasid- 
ered in analyses based on that subgroup- For example, it nras been s^ggssitied 
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that the BSQ respondent subgroup tends to be younger than the BSQ eligible 
nonrespondents and that the BSQ eligible subgroup is younger than those not 
eligible for BSQ administration. This result may or may not affect inter- 
pretation of subsequent analyses.* If one were considering only the subset 
of BSQ respondents on some variable which is unrelated to age (such as 
place of residence) , then the fact that BSQ respondents were younger than 
nonrespondents and ineligibles should not, in itself, restrict generali- 
zations of results to the entire eligible groups or to the total populations. 
On the other hand, if a. variable strongly related to age were being consid- 
ered, any generalizations to larger populations would not be warranted without 
first considering the fact that BSQ respondents were younger. 

For analyses involving comparisons of the UB and CS groups, the dif- 
ferences considered in this section are relatively less important. For 
the large majority of differences examined, the extent and direction of 
subgroup differences was similar within the UB and CS groups. If bias 
within the two groups are the same, then differences between these two 
groups will not reflect the bias (which is cancelled in the subtraction) . 

VII. SUMMARY 

In this chapter the basic approach to analysis has been presented and 
the quality of the data to be used in analyses has been examined. The 
purposes of this presentation were: (a) to provide the reader with the 
overall framework within which analysis was conducted; (b) to advise the 
reader as to the scope of questions addressed in subsequent chapters; and 
(c) to forewarn the reader of possible misinterpretations of results which 
could occur due to the less than perfect quality of the data analyzed. 

A reiteration of the purposes, procedures, and scope of analysis is 
not considered instructive; however, a review of the findings of the 
analyses reported in this chapter is worthwhile. The findings regarding 
data quality and possible iraplications for analysis are summarized below. 
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A. Return Rates 

The return rate for various instruments have two obvious implications 
for analysis, both of which concern how well the data collected represents 
the data which would have been available with complete return. If 
respondents are like nonrespondents in all relevant characteristics (an 
assumption that is commonly made but rarely justified), then response 
races present no problem for analysis. It was shown, however, that 
respondents differ from nonrespondents and thus that the data in hand do 
not likely reflect the true picture that would have been obtained had 
all data been collected. The greater the return rate, of course, the 
less the nonrespondent group can influence the results obtained, regard- 
less of how different they might be from respondents. 

The results relevant to return rates reported in this chapter 
address both of the possible sources of nonrepresentativencss of collected 
data: (1) individual response rate, and (2) the clustering of nonrespon- 
dents (i,e., the distribution of nonresponse over logical units of 
possible respondents — in this case UB projects) , With the exception of 
return rates for. the D/TQ, most student instruments showed satisfactory 
return rates (75 percent or greater) and showed' no serious response 
differential over projects. -More importantly for analyses involving 
differences between the JB and CS groups, return rates were similar for 
these two groups. With the fairly safe assumption that any data bias, 
introduced as a result of nonresponse, is similar for UB and CS groups, 
comparisons of the two groups should not reflect a bias due to nonresponse. 

Overall student response rate (return of one or more of the question- 
naires) was quite high, 99.8 percent for the UB group and 98,3 percent 
for the CS group, reflecting efforts in the fall 1974 data collection to 
reach all previous nonrespondents. Followup subsampling of students who 
had returned questionnaires during the spring 1974 data collection 
period raised the fall 1974 data return rates to 80.2 percent and 78,1 
percent for the UB and CS groups, respectively. 

Return rates and differential project response was less satisfactory 
for the staff instruments, particularly in light of the importance of the 
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study to those staffing the projects,. Nevertheless, project staff ques- 
tionnaire response was within acceptable Is^els. 

Data Qualit;^ 

High and nomdii ^^erential return rstes do not in themselves assure data 
integrity. Item nor response, ciarsless response , and deliberately mislead- 
ing responses can gr aatly degrade: the data --s^en if 100 percent return of 
questionnaires is rea^lized. Fiirrther, some: ei-rror is to "be expected in large 
computerized data bases due to jhunon mistakfes made in transcribing hard 
copy into machine readable form^i. R-e^srdlass: of the source of errors of 
omission or coniissdLQn, some items i=i ^he ultimate data base may be unusable 
due to: (1) missing data, the absem'ae of a response where one is called 
for; (2) out of range data, responsE.'? that: axe not within the prescribed 
(or reasonable) range of responses:; (^3) multiple responses, the presence of 
more than one re:sponse to an item, s-f^.-pulaxing only one response-; and (A) 
inconsistent data, responses tiist a3r=£ logicslly conflicting. The latter 
broad category inclades skip pa> i; rL.liicxnnsistencies, inconsistencies 
within instrument, and inconsistttens^fss be^tween instruments. 

In attempts to rectify som& ^ the pnroblems of data quality, tech^ 
niques of imputation are often smplkjyexi. The use of imputations is effec- 
tively that of creating data wners^ rherre -were unusable diata previously. 
Most imputati:23n techniques havs pctentlal for introdi»cing some erroneous 
data; however., the gain realized rtnrpiigh sound techn2.ques of imputation 
generally offsets the loss due tc iurrroduction of some error. 

The impiiication of the varimis f^orms of potential data error for 
analysis are qsuite obvious. Large ^oportions of unavailable or unusable 
data can easiiy creste a sltQation wherre arorailable data are not representa- 
tive. of the entire rrespondent girnnip., par-ticularly if certain relevant 
respondent characteristics are rssLated to the unavailability of the data. 
Inconsistent data and error intzniafciced through imputation may lead to 
fallacious resuits axid misinterjnstatlon of findings. 

Examinations co£ indeterminai:re daica suggested that the incidence of 
multiple and out atf range responses was quite low, accounting for no more 
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than 0.2 percent of the data on* the average, for any given questionnaire 
item. The relative frequency of imputed responses was, on the average, 
even lower. The incidence of item nonresponse was considerably greater; 
however, this data problem seemed to be concentrated within a few items and 
individuals. In terms of the Master File variables, proportions of un- 
available data were, in general, quite low; however, the proportion was 
greater than 20 percent for all of the variables related to the fall 1974 
time point. These high percentages reflected the high nonreturn rate for 
these instruments due to subsampling for followup data collection. In all, 
■Jtlie extent of unavailable data had no serious impact on analysis. 

Examinations of item inconsistency did raise some serious questions 
regarding data quality. Major inconsistency problems arose for the items 
that were nested within various questionnaire routing items. Considering 
the complexity of some of the skip patterns, these inconsistencies are not 
surprising in retrospect. In view of the problems introduced by the skip 
patterns, however, data from items contained in routing items were used 
sparingly in analysis. . 

The extent of logical inconsistent responses within specific question- 
naires was, in some cases, considerably greater than would be desired. Two 
items of the PDQ were answered inconsistently by more than 20 percent of 
the project directors^ Proportionately large numbers of inconsistent 
responses were, however, traced to items which appeared on reexamination to 
be somewhat ambigious. Nonetheless, incidence of inconsistency still 
remained at upwards of 5 percent for some relatively unambigious items. 

The observed inconsistency of responses between instruments is also a 
matter of concern- Since such inconsistencies typically reflect response 
differences between two different reporting sources, they pose questions as 
to the credibility of one of the sources. The incidence of such inconsis- 
tencies was high in light of the relatively objective nature of the responses 
compared. Discounting comparisons in which fewer than 250 cases were 
involved, inconsistent response rates were almost as high as 25 percent for 
come comparisons. Although inconsistent data were not used in analysis, it 
is possible that the remaining students with nondiscrepant responses were' 
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not representative of the entire group and that analyses were somewhat 
biased as a result. The overall picture of intersource inconsistencies is 
somewhat brighter considering the total student group on the entire set of 
Master File variables. The maximum percentage of inconsistent data for the 
total group of 6,050 students on the 22 Master File variables was less than 
4 percent. 

The danger of high rates of observed inconsistency is not in the items 
for which that inconsistency is observed, since any response observed to 
be inconsistent with another response was not used in analysis. The real 
problem exposed by the observance of inconsistencies in the data lies with 
those items which were not amenable to consistency checks • An observed 
high rate of inconsistency is s3niiptomatic of one or more of several factors 
which could be influencing some or all of the remaining data items (e,g,, 
ambiguity of question wording, inattention or carelessness on the part of 
the respondent, or deliberate attempts to provide false data on the part of 
the respondent). The consistency checks performed signal the strong possi- 
bility of one or more of these factors in the responses of some individuals 
on some items, which reduces the reliability, and thus the validity, of the 
data. 

C, Representativeness of Respondent Subgroups 

The potential problems of nonrepresentativeness of certain data has 
been previously discussed as it relates to questionnaire return rates and 
data quality. Another potential source of nonrepresentativeness is possible 
within the current study; specifically, the fact that the same information 
items were not requested from all student subgroups. The most extensive 
set of student data is potentially available from the subset of students 
who were administered the BSQ, Other subgroups of students (e.g., the D/TQ 
eligibles and the FSQ (Form B) eligibles) could not provide the richness of 
data present for BSQ respondents, due to the limits of the questionnaires 
administered to them. Analysis of BSQ data is, of course, possible, but 
the extent to which the results can be generalized to the total student 
group (and to the population from which these groups were drawn) dep.ends 
upon the extent to which the BSQ respondents are representative of the 
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total group. By using the variables common to all instruments for compari- 
spn, it was possible to conduct an investigation to determine empirically 
the extent and direction of lack of representativeness among certain sub- 
groups of students • 

Statistically significant differences were detected for almost all of 
the subgroup comparisons made. Some of these differences were logically 
. related to subgroup definitions, and thus unavoidable (e. g. , the fact that 
there was a greater incidence of high school dropout for the D/TQ respondents 
than for the BSQ respondents was not surprising in light of the fact that 
ESQ eligibles were defined as those at the same school or project at time 
of questionnaire administration and the D/TQ eligible subgroup was defined 
as the complement of the BSQ subgroup) . While the direct implications for 
analysis interpretation due to subgroup differences cannot be directly 
stated, the results indicate that there is a strong possibility of bias in 
results obtained for specific questionnaire respondent subgroups. 

In Chapter 6, for example, an examination is made of perceptions of 
the UB program by UB participants. These results were obtained for BSQ 
respondents exclusively and as such they represent a source of possible 
bias in that they may not reflect the perceptions of all UB participants. 
The reasons for the potential bias is that BSQ respondents are, in general, 
younger than other BSQ nonrespondents or BSQ ineligibles;- and the respon- 
dents have, typically, been with the UB program for a longer period of time 
than either of the other two subgroups. This would suggest, intuitively, 
that the results presented in Chapter 6 are more favorable to the program 
than results which would have been obtained had this information been 
available for all members of the UB sample. 

Fortunately, for the large majority of differences examined, the dif- 
ference between subgroups of respondents within the UB group was quite 
similar in form to the difference within the CS group. This suggests, but 
does not guarantee, that whatever biases are introduced in UB group results, 
they are of the same nature (and presumably of the same magnitude) as those 
introduced in the CS group. If this is the case, then comparisons between 
the CS and UB groups should be relatively free of bias, even when such 
comparisons are being made within a particular respondent subgroup (such as 
BSQ respondents). 
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Chapter 4 



Characteristics of the Upward Bound Staff 
I . GENERAL 

This chapter and the two chapters which follow provide a description 
of various aspects of the national UB Program in program year 1973-74, 
based on the data gathered in staff and student questionnaires. To provide 
national profiles, the results are presented as national estimates of the 
characteristics of the UB staff, students, and projects across the popula- 
tion of 333 regular UB projects—^ operating in coterminous United States in 
program year 1973-74. 

The primary purpose of this chapter is to provide a national descrip- 
tive profile of the staff members serving the UB projects. More specifi- 
cally, answers to the following question^ are pursued: (a) what were the 
demographic and background characteristics of UB project staff .^members? 
(Sec tion II); (b) what educational background, training, and wprk experience 
did UB project staff members have? (Section III); (c) what/tasks did UB 
project staff members perform and how did they divide their time in ful- 
filling their respective positions? ■ (Section IV); (d) what attitudes did 
UB project staff members hold on issues having impact on educational inter- 
vention programs? (Section V). 

Tabular data are presented within each of three staff categories: 
project directors, project instructors, and project counselors. The total 
weighted numbers (WN) of respondents reported in the tables in this chapter 
are national estimates of the number of staff in each staff category for 
the UB projects at the time of the study. The questionnaire data obtained 
from 48 of 54 sampled project directors are used to describe ^:he estimated 



This excludes special veteran projects and demonstration projects. 
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333 directors in the nation. Similarly, the profile of an estimated national 
total of 2,973 project instructors is derived from questionnaires returned 
by 154 of 211 sampled project instructors. Finally, representing the 
national estimate of 1,184 UB project counselors are the 84 of 104 sampled 
project counselors who returned . questionnaires. Because of unequal weight- 
ing and the relatively small number of cases (only two projects per strata) 
caution should be taken in interpreting results of estimates based on items 
with a large amount of nonresponse because, in general, the nonresponding 
cases will not be distributed evenly (or proportionally) over the valid 
response categories. For this reason, the numbers of nonrespondents to an 
item are included in the tables. Because of rounding error, the total sum 

of proportions in tabular presentations will vary around 100 percent; also 

2/ 

the sum of weighted numbers will vary around 326^ for the project directors, 
around 2,973 for the project instructors, and around 1,184 for the project 
counselors. 

Although questionnaire responses are the primary data for this and 
following chapters, some findings and perceptions from the visits to 15 
project sites will be used to augment and aid in interpretation of the 
primary data. Some topical areas were not covered or were covered only 
tangentially in the questionnaires (e.g., nature and functions of advisory 
groups, evidence of institutional commitment, adherence to federal guide- 
lines), and questions concerning these topics can be addressed only by the 
information gained during site visitation. For other topics, which can be 
addressed by questionnaire data, clarification, confirmation, or contra- 
diction may be gained by insights from the considerably richer observation 
base of site visits. 

While the benefits of using information collected during site visits 
are obvious, it should be kept in mind that hard data were not gathered on 

The sum of the sampling weights for project directors, which estimates 
the number of project directors (and also the number of projects) in coter- 
minous United States, is 326. This figure differs from the known actual 
number of projects, which is 333. Since the sampling weight for a project 
is the inverse of the probability of selection of that project, the sum of 
these weights will vary depending on the particular sample of projects 
which io drawn. The expected value of this sum, over all possible samples, 
will be 333, but for any particular sample may not total exactly to 333. 



program operations or other features of UB projects, since the. essential 
effort was to "discover what was there" and considerable variability was 
anticipated. In this respect, it was not possible to approach each visit 
in the same way or to gather the same kinds of information, partly because 
circumstances varied and partly because of the subjective nature of site 
visits. Moreover, it was possible to visit only 5 sites during the academic 
year and 15 summer programs. As a result, reports of site visit data must 
be viewed as an impressionistic and sometimes inferential look at Upward 
Bound in action. 

Before moving to presentation of results, three topics require consid- 
eration: (a) adjustments of sample weights, fb) sampling errors, and (c) 
other possible sources of data error. These matters are treated briefly in 
the remainder of this section, but relate to all results to be presented in 
this and subsequent chapters. 

A, Sample Weights and Adjustments for Instrument Nonresponse 

In the complex sample desiirgn used in the UB survey, units of study 
(individuals or projects) were selected into the sample with unequal prob- 
abilities. Therefore, tc ±n£l5a:te the sample to the size of. the population 
being estimated (so that each-;p:erson or project represented the correct 
number of persons or projeipK, respectively, in the population), sample 

weights that were inversely proportional to the probability of selection 

3/ 

were applied to individual answers.—' Consequently, in the data tables 
presented in this and subsequent chapters, individuals or projects do not 
represent equal numbers of cases in the population. 

In producing these national estimates adjustments were made to correct 
for the failure of some individuals to return questionnaires (instrument 
nonresponse). In general, adjustments for nonresponse were made by increas-- 
ing the weight assigned to the responses of those judged to be most similar 



— See Appendix B for a discussion of the use of sample weights. In 
this chapter, where staff members are the units of analyses, sample weights 
proportional to the inverse of each person's probability of selection were 
applied to their responses. In this way, each staff member represents the 
correct number of staff members of his staff type in the population. 
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to the nonrespondents. Thus, on the assumption that persons in the same 

projects shared many relevant characteristics, sample weights for nonre- 

spondents of a particular project were assigned to others in the same project. 

If there were no appropriate responding persons in the same project, the 

nonrespondents ' sample weights were allocated to appropriate persons in the 

other project in the same sample stratum since similar projects had been 

placed, together in the strata. The specific adjustment procedures depended 

4/ 

on the unit of analysis. — 

B. Sampling Error 

Whenever a sample is used instead of the entire population, the result- 
ing data are subject to error due to sampling. That is, differences would 
be expected between the results obtained for a given sample and those that 
would be obtaiixed for another sample^or for the population. The rssults 
for the populaxiion ^always remain unkizown, but the larger the .sample, the 
smaller is. the ^pe^rted sampling evTzz. Estimatas of the magnitude of che 
expected sampliiag error can be calcuTatied from sample data, and are termed 
standard errors„cf estimates of population values. However, because of :the 
complex nature of the sample design that was used for the selection of UB 
staff and students, the familiar textbook formulas for standard errors are 
not applicable. 

To provide estimates of standard errors for the large number of esti- 
mated percents that are reported in this and subsequent chapters, and to 
provide them at a reasonable cost, estimated standard errors were computed 
only for selected items. The results were then used to create generalized 
tables of standard errors that provide a general order of magnitude of the 
standard errors for the estimated percents. Each of Chapters 4, 5, and 6 
presents a generalized table that is applicable to that chapter. 

The magnitude of the standard error for an estimated percentage is 
determined by a number of factors, including: (1) the number of prajects 

47" 

— See Appendix F for a detailed discussion of adjustments for nonre- 
sponse. In this chapter adjustments for instrument nonresponse were made 
within staff categories (e.g., sample weights of nonresponding counselors 
were allocated to responding counselors in the same project, or if there 
were none, to responding counselors of the other project in the stratum) « 
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and the number of clients or staff members selected into the sample, (2) 
the magnitude of the estimated percent, and (3) the way in which the char- 
acteristic being estimated is distributed among projects. The formulas and 
procedures that were used in calculating the standard errors are presented 
in Appendix B, and Table 4.1 gives the generalized standard errors for this 
chapter. 

The method for using Table 4.1 is included in the table, but will be 
demonstrated here in the following example. From Table 4.2 (Page 4.8), it 
can be seen that the estisiated percent of instructors who were 36 to 45 
years of age was 17.2, To determine the appraxxmate standard error of this 
estimated percent, cclunn T of Table 4.1 woulH be used, because the esti- 
mated 17.2 percent rela^ies: to instructors andi is based on a sample size of 
154 (total "N"). By enraring the row labeled "15 or 85" percent which 
contains the closest values to 17.2, the standard error of 3,1 percentage 
points is found. This ^alue is the approximate standard error of the 
estimated 17.2 percent whinh can be used to construct confidence intervals 
for the estimate.—'^ If :ona were to construct a 95 percent confidence 
interval, one would be 95 percent sure that the true population value 
(percent of 36- to 45-year-old UB instructors in the population) is between 
10.8 and 23.4 (i.e., 17 - 2(3*1) and 17 + 2(3.1)). The reader is encouraged 
to refer to the standard errors shown in Table 4.1 when interpreting the 
percents presented in the data tables of this chapter to establish some 
guidelines as to the level of precision of the estimates presented .—"^ 



— The confidence interval is a range of values within which one expects 
twe true population value to be. If the same sampling and estimation pro- 
cedure were repeated indefinitely, and for each sample an interval was con- 
structed that was two standard errors on either side of the estimated percent, 
one would find that about 95 percent of these intervals would contain the 
true population value. An :int:erval so constructed is called the 95 percent 
confidence interval. A 99 percent confidence interval is formed by taking 
two and one-half standard errors on either side of the estimated percent. 

— ^ In some of the data tables in this chapter, means as well as percents 
are tabulated. The specific standard errors of these means are displayed 
in the tables with the means. These standard errors are presented separately 
because it is typically not possible to construct simple generalized sampling 
error tables for means. The standard errors of means can also be used to 
construct confidence intervals, and the reader is similarly urged to consider 
these standard errors when examining means. 
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C. Other Sources of Error 

Another important source of error, not related to saiapling, needs to 
be mentioned. The descriptions of the UB program and st^f presented in 
Chapters 4, 5, and 6 are based entirely on the opinions and perceptions of 
UB staff and students. No other data were used. Much of the information 
obtained is objective in nature, and thus subject only to the usual types 
of response error that enter into any set of survey respcmses. But some of 
the data represent subjective evaluations of various aspects of the projects 
by UB staff and participants, and hence are more likely to be affected by a 
conscious or subconscious tendency to place one's own project in a favorable 
light (presumably within individually perceived limits of realism). There- 
fore, particularly in considering these subjective results, the reader must 
keep in mind that the descriptions of UB being presented are the results of 
a questionnaire survey and have not been externally validated. 

II. DEMOGRAPHIC CHARACTERISTICS OF THE UB PROJECT STAPF 

One domain of staff characteristics that m&j hav« an impact program 
operation is that of demographic and background attributes. The .guidelines 
for the UB program suggest, for example, that am attempt be made to match 
the ethnicity of project staff to that of the stnident:s being,- served. There 
are some intuitive arguments for a ma^tching of st2.fx: and students on other 
dimensions, since a staff member with a background similar to that of the 
student would certainly have a potentially better understanding of the 
problems of that student. This subsection describes the age, sex, 
ethnicity, and background of UB project directors. Instructors, and- 
counselors, as estimated for the national UB staff. 

Age . Table 4.2 shows the age distribution of the three categories of 
UB staff members. The project directors tended to be slightly older than 
the instructors or counselors, although most persons regardless of staff 
category were in their twenties or thirties. It can be seen that 56 percent 
of the project directors, 65 percent of the instructors, and 70 percent of 
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Table 4.2 
AGE OF UB PROJECT STAFF MEIIBERS 



Age in Years 



Project Director 



Project Instructor 



Proiect. Counaelor 



25 or le^s 
26-35 
36-45 
46-55 
56-65 
Indetersilnate^ 



5.4 
51.0 
31.2 
10.5 

1.9 



18 
166 
102 

34 
6 



3 
25 
14 
5 
1 



15.9 
48.8 
17.2 
14.0 
3.5 
0.7 



472 
1450 
512 
415 
104 
20 



24 
70 
28 
23 
8 
1 



45.6 
24.6 
16.1 
10.4 
3.4 



540 
291 
190 
123 
40 



27 
29 
14 
10 



Totalsi'^ 



100.0 



326 



48 



100.0 



2973 



154 



100.0 



1184 



84 



NOTS: Table based on responses co PD<^ question 2.aj PIQ question 1; PCQ 
• question 1. For approxiaate standard errors of percencs, refer 
to Table 4.1, columns A, F, and K, respectively, for project 
directors , instructors , and counselors . 

— ^ Percentages are based on weighted responses, adjusted for itistingnent 
nonraspptygs - 

— ^ Sumbeca do not include in s t r ume_n t _npnr Rs pond en t s . 

- / 

— This represents primarily t t_eg ngnr esppns e (i.e., failure to answer 
an iteni) , but also includes multiple responses, out-of-range responses^ 
and inconsistent responses. 

^ Weighted nimbers and percentages tnay not total exactly due to rounding 
error. 

Table 4.3 
SEZ OF UB PROJECT STAFF MEMBERS 



Sex 


Proiect Director 


Proiect Instructor 


Proiect Counselor 










WN 










Male 
Fsmale 

IndeteiTOinate 


88.1 
11.9 


287 
39 


41 
7 


55.2 
43.8 
1.0 


1641 
1303 
30 


89 
63 
2 


53.4 
46.6 


633 
551 


42 
42 


Xotalsi^ 


100.0 


326 


48 


100.0 


2973 


154 


100.0 


1184 


34 























NOTE: Table based on responses to PDQ question 2 .l> ; PIQ question 2; PCO 
question 2. For approximate standard errors of parcants, refer 
to Table 4.1, colunms A, F, and cC, respectively, ror project 
directors, instructors, and counselors. 

— ^ Percentages are based on weighted responses, adjusted for instrumenc 
nonresponse . 

b/ 

— Numbers do not include ins t rt^men t nonr e_spo nd en t s . 
c/ 

— This represents primarily item no n r esoon s e (i.e., failure to answer 
an item), but also includes multiple responses, out*of«range responses, 
and inconsistent responses. 

d/ 



error. 



Weighted numbers and percentages may not total exactly due to rounding 
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the counselors were younger than 36. The large proportion of counselors 
younger than 26 may reflect the fact that college students served as "tutor- 
counselors" at some UB summer programs. In sampling, these tutor-counselors 
were classified in the counselor category. 

Sex, Table 4.3 provides the percentage distribution by sex of the 
three types of staff. Nearly all (88 percent) of the directors were male, 
and the majority of staff members in the other two categories were also 
male (55 percent of the instructors and 53 percent of the counselors). 

Ethnicity , Table 4.4 tabulates the percentage distribution of the 
project staff members by their ethnicity. The greatest proportion of 
project directors were black (47 percent), while the greatest proportion of 
counselors and instructors were white (42 percent and 55 percent , respec- 
tively) . Thirteen percent of the project directors, 21 percent of the 
counselors, and less than 6 percent of the instructors were Mexican-Americans. 
Indians were represented in all three staff categories, comprising 6 percent 
of the directors, 3 percent of the counselors, and 4 percent of the instruc- 
tors. Puerto Ricans and Orientals were represented infrequently and only 
among the instructors. 

Community Background . The type of communities in which staff members 
lived, both through completion of high school and since their high school 
years, is shown in Table 4.5. As youths^ most staff meubers lived in 
cities, outnumbering rural or reservation areas by 3 to 1 through 5 to 1, 
depending on staff category. Since their high school years, even more 
staff members moved to the city, with ratios of city to other types of 
residences ranging from 9 to 1 for counselors and instructors and 18 to 1 
for directors* 

Family Background . Table 4.6 displays the educational attainment of 
staff members' fathers and mothers. The educational level of parents of 
most staff members ranged from grade school to graduate school, with that 
of the mothers slightly higher than that of fathers for counselors and 
instructors. About 25 percent of the project directors' fathers had obtained 
a BA degree or higher, compared to 18 percent for instructors and 9 percent 
for counselors. Eighteen percent of the project directors' mothers obtained 
at least a BA degree as compared to 19 percent for instructors,. and 11 
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Table 4.4 

ETHNICITY OF UB PROJECT STAFF MEMBERS 



Ethfllelty 



Black 

Indian 

Oriental 

Mexican- 
American 

Puerto Rico 
IJhite 

Indeterminate 



Project Director 



%■ 



a/ 



46.7 
6.0 



13.1 



24.2 



WN 



152 
19 



43 



112 



23 
3 



17 



Project Instructor 



7^1 



32.7 
4.3 
0.5 

5.5 
0.5 
55.1 
1.4 



WN 



973 
128 
15 

164 
16 
1639 
39 



54 
5 

9 
1 
81 
3 



Project Counselor 



34.4 
2.6 



21.2 



41.8 



WN 



407 
30 



251 



495 



38 
2 



10 



34 



Total; 



Al 



100.0 



326 



48 



100.0 



2973 



154 



100.0 



L183 



84 



NOTE: Table based on responses to PDQ question 3; PIQ question 3; PCQ 
question 3. For approximate standard errors of percents, refer 
to Table 4.1, columns A, F, and K, respectively, for project 
directors, instructors, and counselors. 

a/ 

~ Percentages are based on weighted responses, adjusted for instrument 
nonresponse . 

— ^ Numbers do not include instrument nonrespondents . 
c-/ 

— This represents primarily item nonresponse (i.e., failure to answer 
an item), but also includes multiple responses, out-of-range responses, 
and inconsistent responses. 

— Weighted numbers and percentages may not total exactly due to rounding 
error. 
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Table 4.5 

COMlJlUNITY OF RESIDENCE OF UB PROJECT STAFF 



Type of 
Community 


Pro.lect Director 


Project Instructor 


Project Counselor 


a/a/ 


WN 






WN 






WN 




Through High 
School 

Rural/ 
Reservation 

City 

Indeterminate^ 


24.2 
71.4 

/ 

' 4.5 


79 
233 
15 


11 
35 
2 


' 16.4 
79.9 
3.8 


488 
2372 
114 


29 
119 
6 


25.4 
71.0 
3.6 


300 
841 
43 


23 
58 
3 


xo taj-s^ 


100.0 


326 


48 


100.0 


2973 


154 


100.0 


n 84 


OH 


Since High 
School 

Rural/ 
Reservation 

City 

Inae t e rmina t e- 


5.1 
88.2 
6.8 


17 
287 
22 


3 
42 
3 


9.1 
83.9 
6.8 


271 
?.501 
202 


16 
127 
11 


9.6 
79.9 
10.4 


114 
947 
124 


12 
66 
6 


Totals^/ 


100.0 


326 


48 


100.0 


2973 


154 


100.0 


1184 


84 



NOTE: Table based on responses to PDQ question 5; PIQ question 5; PCQ 
question 5. For approximate standard errors of percents, refer 
to Table 4.1, columns A, F, and K, respectively, for project 
directors, instructors, and counselors. 



— Percentages are based on weighted responses, adjusted for instrument 
nonresponse , 

b/ 

Numbers do not include instrument nonfespondents . 

— ^ This represents primarily item nonxssponse (i.e., failure to answer 
an item), but also includes multiple re^onses, out-of-range responses, 
and inconsistent responses. 

d/ 

— Weighted numbers and percentages may not total exactly due to rounding 
error . 
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percent for counselors. Table 4.7 tabulates the types of occupation held 

by staff members' parents. Staff members' fathers were principally laborers 

or service workars^'^ of some type (48 percent, 39 percent, and 37 percent 

for directors, instructors, and counselors, respectively), while the mothers 

tended to be homemakers and laborer/service workers (38 and 35 percent, 

respectively, for directors; 52 and 20 percent for instructors; and 40 and 

19 percent for instructors). Further, 20 percent of the directors' fathers 

g I 

were professionals.— This category also accounted for 15 percent of the 
instructors' fathers and 15 percent of the counselors' fathers. Mothers of 
10 to 12 percent of the staff members were professionals, while 11 percent 
or fewer of the mothers were in sales or managerial positions. 

As a group, the UB staff members are young and show a diversity of 
ethnicity that reflects qualitatively, if not quantitatively, the diversity 
among UB participants. Among the staff categories, the ethnic distribution 
of project directors is most similar to that of students as reported by the 
UB data system for program years 1973-74 and as observed in this study (see 
Chapter 7, Table 7.1). Even among project directors, however, there appear 
disproportionately few black staff members for a program which serves about 
60 percent black students; however, the 95 percent confidence interval for 
proportion of black project directors does include the value of 60 percent. 
Observations during site visitation also indicated proportionately smaller 
representation of blacks on the staff than among the students. 

The majority of staff members are male, while participants are mostly 
female (as indicated in figures reported by USOE and the estimates from 
this study); however, with the exception of project directors, the confi- 
dence intervals for percentage of male staff members include values less 
than 50 percent. Family backgrounds of UB staff seem fairly diverse, with 
many staff members providing data which is suggestive of origins in a low 



— The category of laborer and service worker is exemplified by factory, 
farm, mine, or construction workers; bus, taxi, or truck drivers; waiters 
or waitresses; cooks; maids; custodians; guards, policemen; firemen; 
beauticians; seamstresses; and practical nurses or orderlies. 

8/ 

— Including teachers, doctors, engineers, lawyers, social workers, 
accountants, musicians, artists, dentists, librarians, and writers. 
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income family. Many other staff members, however, report family information 
that does not seem concordant with the background of the UB target population. 

It should be pointed out that the UB program guidelines do not require 
exact proportionality of staff and students in terms of ethnicity, nor do 
the . guidelines require the staff to match students in family background or 
sex. There are, however, some arguments for better matching of staff and 
student ethnicity and background. 

III. EDUCATIONAL BACKGROUND, TRAINING, AND EXPERIENCE 
OF THE UB PROJECT STAFF 

A natural. question regarding the UB staff, and one with obvious impli- 
cations, concerns the qualifications they bring to their job. The staff 
questionnaires thus contained several items designed to measure various 
aspects of such qualifications. This section describes the educational 
background and relevant occupational skills, training, and experience of 
project directors, instructors, and counselors. 

A. Past and Current Formal Education - - 

Table 4.8 shows the highest formal educational level attained by UB 
project staff members. Tabulations show that 75 percent of the project 
directors had obtained at least a master's degree, 14 percent had obtained 
a Ph.D. degree, and none had less than a B.A. degree. About 68 percent of 
the instructors had obtained a master's degree or higher, 6 percent had 
obtained a Ph.D. degree, and only 3 percent had not completed a college 
degree. Project counselors reported that 48 percent had obtained a master's 
degree or higher, none had a Ph.D. degree, and 15 percent had less than a 
Bachelor's degree.—*^ 

In general, then, the UB directors, instructors, and counselors were 
primarily college graduates. Further, Table 4.9 indicates that sizeable 
proportions of the staff members were participating in continuing education 
at the time they completed the questionnaires. At that time, about 30 



9/ 

The inclusion of college students, serving as tutor-counselors, in 
the counselor category has probably inflated this figure. 
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Table 4.3 

HIGHEST EDUCATIOJIAL LEVEL OBTAINED BY UB PROJECT STAFF 



Educational Level 



Project Director 



Project Instructor 



Project Counselor 



No college degree 
Degree based on less than 4 years 
work 

B.A. degree 
M.A. degree 
Specialist dipioaa 
Ph.D. degree 



Irdeterainat 



c/ 



0.0 

0.0 
21.3 
50.8 

9.4 
14.5 

4.0 



69 
165 
31 
47 
13 



11 
25 
5 
6 
1 



3.4 



27.0 
51.0 
11.6 
5.5 
1.5 



102 



803 
1517 
344 
163 
45 



43 
74 
21 
10 
2 



11.3 

3.7 
36.3 
42.5 
6.0 
0.0 
0.0 



134 

44 
430 
504 

72 



1 
25 
46 

7 



Total 



100.0 



326 



48 



100.0 



2973 154 



100.0 



1184 



84 



NOTE: Table based on responses to PDQ question 8; PIQ question 8; PCQ question 8. For approximate 
standard errors of percents. refer to Table 4.1. coiumas A. F, and K. respectively, for 
project directors, instructors, and counselors. 
Percentages are based on weighted responses, adjusted for Instrufflent nonresponse. 

Nunbers do not include instruaent nonrespondents . 

Th^s represents primarily item nonresponse (i.e.. failure to answer an item), but also includes 
multiple responses, out-of-range responses, and inconsisteat responses. 

Weighted numbers and percentages may not total exactly due to rounding error. 



Table 4.9 

CURREOT ENROLLMENT IN A DEGREE PROGRAK BT U3 PROJECT STAFF 



Current Iv Enrolled 


Project Director 


Project Instructor 


Project Coun 


selor 




VN 




.a/ 


WK 


>P 




WN 




Ves 
No 

Inde te raiaat 


30.3 
66.3 
2.V 


99 
213 


16 
31 
1 


33.7 
65.5 
0.3 


1003 
1948 
23 


49 
103 
2 


44.7 
54.2 
1.0 


530 
642 
12 


32 
51 
1 


Totals- 


100.0 


326 


i8 


100.0 


?072 


154 j 100.0 


1184 


84 



NOTE: Table based on responses to PDQ questi.on 10; PIQ question 10; PCQ question 10. For approximate 
standard errors of percents. refer to Table 4.1, culurans A. ?. and K. respectively, for 
project directors, instructors, and counselors. 

Percentages are based or. weighted responses, adjusted for instrument nonresponse. 
Numbers dc not include instrument nonrespondents . 

This represents primarily item nonresponse (i.e.. failure to answer an item), but also includes 
multiple responses, out-of-range responses, and inconsistent responses. 

Weighted numbers and percentages may not total exactly due to rounding error. 
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percent of the project directors, 34 percent of the instructors, and 45 
percent of the counselors''^ were enrolled in a degree program. 

B. Position-Related Training 

As shown in Table 4.10, the majority of project directors and counselors 
(81 percent and 57 percent, respectively) and a large proportion of 
the project instructors (39 percent) had attended some type of training 
institute offering special training in teaching, counseling, or program 
administration for "disadvantaged" students* A good deal of this training 
seems to have been received after entrance into a UB staff position. Table 

4.11 shows the percentage distributions of project directors and counselors 
by their attendance in such training institutes since becoming UB staff 
members; 59 percent of project directors, and 37 percent of counselors had 
attended such training institutes since joining the UB staff .—"^ Table 

4.12 tabulates the percentage of instructor?? who had received UB in-service 
training. Forty-one percent of the instructors reported some form of in- 
service training since their first association with the UB program. 

Table 4.13 tabulates the numbers of various types of college counseling 
courses (semester equivalent) that UB counselors had completed. Eighty- 
seven percent had completed some course work in educational counseling, and 
44 percent had completed four or more such courses. The following propor- 
tions reported having had at least one course in the remaining areas of 
counseling: minority group counseling, 52 percent; personal counseling, 76 
percent; vocational counseling, 66 percent; and other counseling, 11 percent. 

Table 4.14 indicates the number of hours of supervised counseling 
practice reported by counselors in each of several areas. About 75 percent 
had some supervised training in educational counseling; 67 percent in 

— The inclusion of college students, serving as tutor-counselors, in 
this counselor category has probably inflated this figure. It should be 
recalled that 15 percent of the counselors had not completed a B.A. degree. 

~ Considering that only 27 percent of the project directors reported 
never having attended a training institute (Table 4.10) and 42 percent 
reported not having attended since becoming a UB staff member (Table 4.11), 
it follows that 15 percent of the directors had participated in this type 
of training prior to to their joining the UB staff and not since. Similarly, 
for counselors, participation .in such training only prior to association 
with UB was restricted to 20 percent. 

156 



4.17 



o 



U 
O 
iH 

(U 
03 

a 
p 
o 
u 



u 
o 



o 
o 

CO 

a 

M 



U 

o 
u 



u 
o 

u 

0) 

u 



u 

0) 

o 
u 

Ph 



CO 



0) 



in 



00 
00 
CO 



00 
CM 



O 



00 C7N 00 



CM 

m 



m 

CM 



CM 



in 
o 



CM CM 



C3> 

oc 



on 
m 



O 



00 

o 



o 


rH 




CM 


o 


CM 




O 


O 


o 


CM 


rH 






o 



CM 



cn I 

tH I 



00 cn 



ON 

00 



00 00 



00 
CM 



in 



CM 











c 






o 






c 






cd 


0) 












na 






•H 




u 






o 


U 


o 


e 


0) 




4J 








CO 


CO 


-d 






O CJ 






:2: M 



00 



00 



o 
o 



cn 

CNJ 



00 



o 
o 



tH 

Cd 
o 

H 











1 












> 


































& 


CO 






















cd 






• 






tH 






iH 








• c 










o 






1-1 






4J 






CO 


























CO 






p; 






o 




Ph 


P 






iH 






o 










rH 














rH 




o 






*H 






^) 






CO 






Q) 


rH 






o 






Cd 






H 








CO 




o 


Ll 


P-i 










tH 




}^ 


(U 


CO 


(U 


CO 




MH 




iH 


(U 


p 


,—1 


)^ 


Q 






CJ 




M 




o 


CO 


'O 


*H 


4J 


rj 


4J 


r; 




CO 


(U 




d) 


Cj 






}^ 


CO 




dJ 






C3u 


o 


O* 






Q 


MH 




pu, 


o 


p 








o 


CO 


4J 




JH 


CO 




o 


CJ 


CO 


U 




CD 


u 




CO 






a 




CO 


o 


-a 


}-4 


Ou 




O 


CO 


cd 


4J 


0) 


-a 


U 






0) 




§ 




g 








CO 


-a 



-a 

CO cd 

cd e T-j 
•H o 

O Ou 
H U 
^ O4 U 
cd Ou o 
H cd M-i 



H 

o 
2: 



(0 

•§ 

rH 

u 
c 



o 

CO 



• 




4-1 






(U 




p 






CO 










P3 










0 








• 


D< 










CO 




s 




0 


(U 








u 






4-1 




u 












0 














an 




00 










•H 






}^ 
















6 




;5 


CO 


P 


p 




CO 


0) 


0 


}.! 




p; 


CO 


u 


4J 




cd 






CO 






0 


0 






0 


a 


4J 


•H 




4.) 


es 




}H 




cu 


u 


p 












MH 




p 










rH 










•H 




rH 






Cd 


u 








MH 


CO 


u 


CO 






•H 


cd 


p 


• 




CO 






CO 


« 


c 






u 




0 




cd 






u 


rH 




(I) 


•H 


a 


Cd 




•tJ 




•H 


U 


cn 


C3 






0 




0 




-a 


u 


CO 


o« 


cc 








CO 




cd 


u 


0 




0 




0 


Ci. 




Ci< 


•» 


c 


CO 




CO 


CO 




<u 


0 


(U 


(U 


>> 


}^ 






CO 


cd 








§ 


a 






0 








c 


a 




CO 


u 






CO 


0) 






B 




00 


00 


3 


cu 


u 


cd 


-H 


u 


4J 




4J 


OJ 


u 


•H 


(U 






CO 




00 








>^ 




u 




•H 


rH 


cd 




0 




•H 


M 


a) 




(U 






&< 


-a 




Cd 








p 


6 


0 




CO 


rH 


•H 




c 


cd 


a 






cd 




c 


CU 


p 






•H 




0 


CO 


0) 




CO 






u 




u 




(U 


cd 


0 


a 


CO 






c 


<D 


(U 


6 


CO 




CO 


CO 


P 


(U 


0 


(U 


a 




00 


-a 


U 


0 




cd 




Cu 


a 


-a 




CO 


Q) 


CO 




a 


u 


U 


Q) 




0) 






U 




0 




CO 




00 


u 


B 


•H 


Q) 


•H 




p 




rH 








H 


Itip 


3: 








p 




5l 


^1 


^1 




^1 



157 

4.18 



ERIC 



Table 4.11 



ATTENDANCE IN POSITION RELATED TRAINING INSTITUTES 
SINCE BECOMING UB PROJECT STAFF MEMBER 



Attendance In 
Training Institutes 


Project Director 


Project Counselor 








^/ 


WN 


N^^ 


None 
One 

>fore than one 


41.5 
17.2 
41.3 


X35 
56 
135 


20 
9 
19 


63.4 
23.9 
12.8 


751 
282 
151 


54 
18 
12 


Totals^^ 


100.0 


326 


- 48 


100.0 


1184 


84 



Note: Table based on responses to PDQ question ll.b; PIQ question 11. b; PCQ 
question ll.b. For approximate standard errors of percents, refer 
to Table 4.1, columns A, F, and K, respectively, for project 
directors, instructors, and counselors. 

— ^ Percentages are based on weighted responses, adjusted for instrxiaent 
nonresponse . 

— Numbers do not include ins t r ua en t no nr v ond e n t s . 
c/ 

— Ifeightea nuabers and percentages may not total escactly due to rounding 
error. 



Table 4.12 

INSEKVICE TRAINING OF UB PROJECT STAFF INSTRUCTORS 



Inservice Training 




WN 




c/ 

Had participated^ 
Had not participated 
Inae terminate— 


41-. 2 
49.7 
9.1 


1224 
1479 
270 


60 
80 
14 


Tocals^^ 


100.0 


2973 


154 



NOTE: Table based on responses to PIQ question 23a. J'or approximate 
standard errors of percents, refer to Table 4.1, column F. 

— ^ Percentages are based on weighted responses, adjusted for instrument 
nonresponse . 

Numbers do not include instrument nonrftspondents . 

c/ 

— Category includes analysis imputations, 
d/ 

— This represents primarily item nonresponse (i.e., failure to answer 
an item), but also includes multiple responses, out-of-range responses, 
and inconsistent responses. 

e/ 

— Weighted numbers and percentages may noc total exactly due to rounding 
error. 
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Table A. 13 

KCMBER OF COLLEGE COtTRSES SPECIFICALLY REUIED 
TO COtJHSELISG COKPLETSD BY UB COUNSELORS 



Type of CounaeXlng Courso 



Nuaber of 
Cotirsea^/ 



Educacioaal Coimsellng 



0 

1-3 
4 or more 
Inaecenainacef^^ 



11,6 
42,9 
4A.3 
1.1 
100.0 



138 
509 
524 
13 

1184 



9 
32 
42 

1 
84 



Minority Group Counseling 



0 

" 1-3 
4 or more 
IndeCernilnaCi 
Tocal-^ 



36,7 
42,9 
9.1 
11,3 
100,0 



434 
507 
108 
134 
1184 



2S 
39 
8 
9 
84 



Personal Counseling 



15,4 
44. A 
31,2 

Indecerminacer' 9, 1 
100,0 



0 
1-3 
4 or more 



Tocal-^ 



182 
524 
369 
108 
1184 



11 
36 
32 
5 
84 



Voca clonal Counseling 



0 
1-3 
4 or more 
IixdecerminaCf 
Tocal-^ 



27,9 
58.3 
7,2 
6,6 
100.0 



k/ 



Other Counseling 



0 
1-3 
4 or more 
Xndeterminacef^' 
Xocal-'^ 



26.1 
7.3 
2.7 
■'63,3 
100,0 



330 
691 
85 
79 
1184 



309 
93 
32 
730 
1184 



20 
49 
10 
5 
84 



16 
10 
4 
54 
84 



MOTE: Table based oa responses to PDQ quescion 12, For approximate 
standard errors or percents, refer to Table 4.1, coluain K, 

— ^ Courses as semester equivalents, 

— ^ Percentages ate based on weighted responses, adjusted for instrument 
aonresponse , 

c/ 

— Numbers do not Include instrument nonrespondenta . 

— ^ This represents primarily item non response (I.e. , failure to ansver 
an item), but also includes multiple iesponses, out-ot-range response?, 
and inconsistent responses. 

e/ 

— Weighted numbers and percentages may not total exactly due to rounding 
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tibia ^.14 





jluaber of Hours- 


1 


i ^ 


1 




0 


21.3 


253 


19 




1-20 




651 


39 




20 cr a^a 


19.6 


232 


22 




c/ 




1 LA 


4 




Totol^/ 


• 100.0 


' 1184 


34 




0 


33.5 


400 


27 




1-20 


34.3 


412 


23 




20 or stoTtt 

H ft r a r^si^A c jr^^ 

To cai— 


17.6 


209 


16 




U. / 


18J 






100.0 


1134 


34 




0 


24.5 


290 


13 




1-20 


38.2 


v-32 


31 




20 or oors 


23 .6 


339 


23 




c/ 

Toral— 


3.7 
ICO.O 


103 
1134 


7 
34 


Vocaclonal Couosol^g 


0 


33.3 ■ 


434 


27 




1-20 


37.9 


449 


36 




20 or mora 
lade caninacer^^ 


U.4 


159 


12 




10.4 


123 


9 






100.0 


1134 


34 




0 


31.9 


377 


22 




1-20 


6.5 


77 


8 




20 or xor« 




33 


4 






53.5 


593 


50 






100.3 


US4 


34 



MOTS: Tab la basea oa reapooaea to ?CQ ctueacioa 13. Tor approxiaack 

a can dard "errors, r tier co Tabla 4.c., coluaa S. 

Perccacagaa are baaad on veigcicad raaponaasT adjuiCiid for Inacr^ftne 
nonrsd^onsa* " 



Uumbara do cqc 



luda iaatrrcaaac ncgraatandfenra • 



b/ 
c/ 

— Thia rapvaaanca priaarily itaa nonrsspopsa (t.a. , faiiure co anaw<r 
an icsss) « buc also is.cludaa 3il:lpld reapacaas, 3UC-of-ranga rssponaaa, 
and incotisl5ceiic responaas. 

d/ 

— Velghcad airabars and parcencagaa lay zoc cocaJL exactly dua :o rousidis 
error. 
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personal counseling; 52 percent in minority group counseling; and 51 per- 

12/ 

cent in vocational counseling, — 

Table 4.15 presents the types of teaching certificates held by UB 
instructors. About 75 percent of the instructors had some form of teaching 
certificate, including 5 percent Cof the total) who held a temporary or 
provisional certificate. The highest teaching certificate offered by the 
state was held by 48 percent of the instructors. 

C, Position-Relat e d Experience 

Most UB project directors had several years of experience working with 

disadvantaged students either in an administrative capacity or in some 

13 / 

other capacity. Table 4.16 shows the total experience — of project direc- 
tors with programs for disadvantaged students. It can be seen chat 76 
percent of the project directors had accumulated three or more years of 
experience in administering progra^is for disadvantaged youth, and 56 percent 
had at least five years of experience. Further, 23 percent of the project 
directors reported three or more years of additional experience, other than 
administrative, in working with disadvantaged youth, and 52 percent stated 
at least one year of experience in this capacity. 

Tables 4.17 and 4.18 show the types of programs in which UB directors 
had gained their administrative and nonadministrative experience, respec- 
tively. It can be seen that the directors had obtained most of their 
experience in both areas from their current UB positions. A majority of 
the directors either had no previous experience in such programs, or did 
not respond. — 

UB project instructors were asked to indicate their experience teaching 
in full-time and part-time positions. Table 4.19 shows that 82 percent of 
the instructors reported one or more years' experience teaching full-time, 



12/ 

— These percentages were probably somewhat deflated by the~ inclusion of 
tutors-counselors, who were college students, in the counselor category. 

13/ 

— The total experience was determined for each UB director by aggre- 
gating over uhe categories: his present UB project, another UB project, 
a Talent Search project, and other projects. 

14/ 

— The rates ot item nonresponse were very high for the categories other 
than "the present UB project." 
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Table 4.15 



TTPE OF TEACHING CERTIFICATE HELD 3Y UB STAIT IKSTRUCTORS 



Tvije of Certificate 


.3/ 


\^ 




riow certxxxed 


25 


.0 


744 


39 


Temporary, provisional 


4 


-9 


145 


7 


Regular certificate, but less than 










highest offered by state 


20 


^2 


601 


31 


Highesc teaching certificate offered 










by the state 
c/ 

laaeteraiaate— 


48 


.4 


1438 


74 


1 


-5 


46 


3 


Totals^^ 


100 


-0 


2974 


154 



NOTE: Table based on responses to PIQ question 12. For approxiozte 
standard errcrs, refer to Table 4.1, column ?. 



— ' Percentages are based on weighted responses, adjusted for instruaeot 
nonresponse . ' 

Nuabers do not include instrument nonrespondents . 

This represents prinarily itea nonresoonse (i. e, , failure to answer 
an item), but also includes multiple responses, out-of-range responses, 
and inconsistent responses. 

Weighted numbers and percentages xsay not total exactly due to rounding 
error. 



Table 4.16 

TOTAL EXPERIENCE OF OB PROJECT DIRECTORS IN 
PROGRAMS FOR D7.SADVA11TAGED YOUTH 





In Administrative 
Capacitv 


In Other Than 
Administrative 
Capacitv 


Ye.\rs of Eerier iencc 








.a/ 






Inae teminate-*' • 








33.7 


no 


14 


Less than 1 


7.2 


23 


4 


14.4 


47 


8 


1 or 2 


16.5 


53 


9 


28.5 


93 


14 


3 or 4 


20.8 


67 


10 


7.7 


25 


4 


5 or 6 


38.2 


125 


13 


7.6 


25 


4 


7 or more 


17.4 


56 


7 


8.1 


27 


4 


Total s^^ 


100.0 


326 


48 


100.0 


326 


48 



NOTE: Table based on aggregate data of responses to PDQ questions 1-b 
and I.e. For approximate standard errors of percents, refer to 
Table 4.1, column A. 



— Percentages are based on weighted responses, adjusted for ins t rumen r 
nonresponse . 

— ^ Numbers do not include instrument nonrespondents . 
c/ 

— This represents primarily item nonresponse (i.e., failure to answer 
an item), but also includes multiple responses^ out-or-range responses, 
and Inconsistent responses. 

— ^ Weighted nucbers and percentages may not total fi;<actly due to rounding 
error . 



Table 4.17 



EXPERIENCE OF UB PROJECT DIRECTORS ADMINI STRATI ON 
OF FROGRAMS FOR DISADVANTAGED TOUTH 



Years of Experience 



VH 



As Frojecc Director of This 
UB Frojecc ' 



Less than 1 
1-2 

5 or more 
Tocal-^ 



26.4 
21.6 
25.5 
26.5 

100.0 



86 
70 
83 
86 
326 



As Project Director of Another 
UB Project ^^.^^ 



One 

Less than 1 
1 or more 
Indetemi nate^^ 
Total-^ 



46.1 
2.6 
6.5 

44.8 
100.0 



150 
8 
21 
146 
326 



C. As Director of Ti> Project 



One 

Less than 1 
1 or more 
lade t ennina te^^ 
Total— 



41.4 
4.4 
1.9 

52.3 
100.0 



135 
14 
6 

171 
326 



As Director of Other Projects 
Servian Disadvantaged "^outh 



One 

Less than 1 

1-2 

3-4 

5 or more. 
Inde teminate^^ 
Total-^ 



21.5 
8.0 

19.4 

16.2 
3.8 

31.2 
100.0 



70 
26 

6a 

53 
12 
102 
326 



NOTE: Table based on responses Co PDQ question l.b. For approximate 
standard errors of pircants, reftr to Table 4.1, column A. 

— ^ Percentages are based on weighted responses, adjusted for i nstruoent 
nonresponse . 

b/ 

~ Numbers do not include instrument nonrespondents . 
c / 

— This represents primarily it eg nontesponse (i.e., failure to answer 
an item), but also includes multiple responses, out-of«range responses, 
and inconsistent responses, 

— ^ Weighted numbers and percencagej a^^f^not Cotal exactly due to rounding 
. error. J. 0 O 
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table 4.18 

EXPEKIOCE 0? UB PROJECT DIRECTORS UITH PROGRAMS FOR DISADVANTAGED 
YOUTii IN OTHER THAN ADMi:<ISTRATIVE CAPACITY 





Years of Experience 


r -a/ 


WN 


by 










A« In Some Capacity Other Than 
Director or This UB Proiccc 








One 


42.7 


139 


19 


Less than 1 


13.4 


44 


7 


1-2 


23.6 


77 


11 


3-A 


1.8 


1 6 


1 


5 or 3iore 


5.8 


19 


4 


laderenaiaate^^ 


12.6 


41 


6 




100.0 


326 


48 


B. In Soae Capacity Other Than 
Director of Another U3 Pro-?ect 




1 




j One 


50.2 


170 


24 


1 One 

1 Indeterminate-^ 
1 Xotalr* 


3.7 


12 


2 


44.5 


144 


22 


100. 0 


326 


48 


C. In Some Capacity Other Than 
Director of TS Prolect 








One 


52.0 


170 


24 


Less than 1 


1.9 


6 


1 


Inde te minate^^ 
Total^/ 


46.1 


150 


23 


100.0 


326 


48 


D. In Some Capacity Other Than 
Director of Other Project 
Ser'/lnj? Disadvantaged 7 juvh 








Ocie 


33.1 


108 


14 


Less than 1 


6.4 


21 


4 


1-2 


14.7 


68 


8 


3-4 


5.9 


19 


3 


3 or nore 


S.l 


26 


3 


c/ 

Inda c s raiaa c e— 
Total-' 


3i.8 

100.0 

— , 1 


104 
326 


16 

'^48 



NOTE: Table based on responses to PDQ question I.e. For approxliaate 
a^iandard errors of results, refer to Table 4.1, column A. 

— ^ Percentages are based on weighted responses, adjusted for iastnanent 
nonresponse . 

5/ Numbers do not include instrument' nonrespondents ^ 
c/ 

— This represents priaarlly item nonresgonse (i.e., failure to answer 
an item), but also includes multiple responses, out^of-range responsiss, 
and inconsistent responses. 

Weighted numbers and percentages may not total exactly due co rounding 
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Table 4.19 



UB INSTRUCTORS* YEARS OF TEACHING EXPERIENCE 
IN FULL-TIME AND PART-TIME POSITIONS 









Years Experience 


Full-Time 


Part-Time 




WN 






WN 


















None 


3.1 


91 


6 


8.1 


240 


12 


Less than 1 


3.8 


114 


7 


6.1 


181 


11 


1-2 


10.4 


309 


16 


15.1 


449 


17 


3-4 


10.2 


302 


16 


12.5 


372 


22 


5-9 


25.7 


765 


37 


10.1 


300 


19 


10-14 


10.6 - 


'•314 


17 


2.4 


72 


3 


15--30 ' 


22.4 


666 


34 


1.7 


52 


3 


30 or more. 


2.7 


79 


7 


0.0 






c/ 

Inde t e rmin a t e— 


11.2 


332 


14 


44.0 


1307 


67 


Tot^ls^ 


100.0 


2973 


154 


100.0 


2973 


154 


L-,-....,. , .1 _. . . 











IK'TE: Table based on responses to PIQ question 13. For approxiniate 
standard errors of percents, refer- to Table 4.1, column F. 



— Percentages are based on weighted responses, adjusted for instrument 
nonresponse . 

Numbers do not include instrument nonrespondents . 

c/ 

— This represents primarily item nonresponse (i,e., failure to answer 
an item), but also includes multiple responses, out-of-range responses, 
and inconsistent responses. 

Weighted numbers and percentages may not total exactly due to rounding 
error. 
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and 61 percent had taught at least five years in full-time positions. 
About half the instructors also had part-time teaching experience. 

Table 4.20 tabulates the experience of UB project instructors in UB 
summer and academic year programs. A large majority (89 percent) of instruc- 
tors had served in at least one summer program, and almost half the instruc- 
tors reported experience in at least one academic year program. Table 4.20 
also indicates the experience of UB project instructors in teaching minority 
groups or disadvantaged students prior to joining the UB staff. Over 40 
percent of the instructors reported less than one year of experience teaching 
such students prior to becoming a UB staff member. 

UB project counselors were asked to indicate their. total experience 
counseling in full-time and part-time positions. As seen in Table 4.21, 61 
percent of the counselors reported one or more years of counseling experience 
in a full-time position; about 22 percent reported at least five years of 
full-time counseling. • Almost two-thirds of the counselors reported some 
part-time counseling experience. 

The upper panel of Table 4.22 presents the number of summer and academic 
year sessions of UB experience by project counselors. Well over half the 
counselors had worked in at least one UB summer program, and about three- 
fourths of the counselors had served in at least one academic year program. 
The lower panel of Table 4.22 shows the number of years of experience that 
project counselors had gained in counseling minority groups or disadvan- 
taged students prior to becoming UB staff members. Less than half the 
counselors reported a year or more of such experience.—^ 

D. Summary of UB Staff .Training and Experience 

The results presented in this section strongly indicate that UB staff 
members were generally well educated and showed a good deal of involvement 
with furthering their education. They were generally well trained for 
their particular position in the UB program and showed evidence of continuing 



— Again, the large proportion (57 percent) with less than a year's 
experience may reflect the presence of college students who served as 
tutor-counselors in the counselor category. 
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Table 4.20 



EXPERIENCE OF UB PROJECT INSTRUCTORS IN 
RELATED INSTRUCTIONAL POSITIONS 



ERIC 



A. Experience of U3 Project Instructors with UB Simmer and Academic 
Year Programs 



Program Experienci 



None 

One 

Two 

Three 

Four 

Five or more 
■Indeterminate^^ 



Total; 



e/ 



Summer 



7>l 



6.7 
30.4 
18.3 
12.6 
10.3 
17.8 
3.9 
100.0 



WN 



201 
905 
545 
373 
306 
527 
115 
2973 



^1 



11 
51 
19 
20 
20 
29 
4 

154 



Academic Year 



16.9 
18.7 
8.6 
7.0 
. 5.6 
9.5 
33.8 
100.0 



WN 



504 
553 
257 
208 
165 
282 
inn-i 

2973 



27 
30 
l-i 
8 
11 
16 
48 
154 



B. Years Experience Teaching Minoricy Groups or Disadvantaged 
Students Prior to Work with UB 



Years Extd er ienc e 



Less than 1 

1-2 

3-4 

5 or more 
IndetermixiaCi 
e/ 

To tals^' 



M 



7A' 



43.1 
21.1 

8.3 
26 9 

0.7 
100.0 



WN 



1280 
626 
245 
801 
21 

2973 



65 
32 
14 
42 
1 

154 



NOTE: Table based on responses to PIQ questions 14. a and 15. For 
approximate standard errors of percents, refer to Table 4.1, 
column F. 



Imputations have been performed on these data. 



Percentages are based on weighted responses, adjusted for instrument 
nonresponse . 

c/ 

— Numbers do not include instrument nonrespondents . 
d/ 

— This represents primarily item aonresponse (i.e., failure to answer 
an item), but also includes multiple responses, out-of-range responses, 
and inconsistent responses. 

e/ 

— Weighted numbers and percentages may not total exactly due to rounding 
error. 
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Table 4.21 



UB COUNSELORS' YEARS OF COUNSELING EXPERIENCE 
IN FL'LF^-TIME AND PART-TIME POSITIONS 



Years Experience 


1 — 

Full-Time 


Part-Time 




WIN 


IN 


A — 




N— 


None 


12.6 


150 


8 


6.5 


76 


7 


Less than 1 


11.5 


136 


7 


' 21.4 


253 


15 


1-2 


28.9 


342 


24 


16.7 


198 


15 


3-4 


10.4 


123 


13 


6.7 


80 


6 


5-9 


9.3 


110 


10 


14.7 


174 


13 


10-14 


12.4 ; 


147 


12 


1.3 


15 


1 


15-30 


0.0 






1.7 


20 


1 


30 or more 


0.0 






0.7 


8 


1 


c/ 

Indeterminate- 


14.9 


176 


10 


30.4 


359 


25 


Totals^^ 


100.0 ' 

1 


1184 


84 


100.0 


1184 


84 



NOTE: Table b ased on responses to PCQ question 14. For approximate 
standard errors of percents, refer to Table 4.1, column K. 



— Percentages are based on weighted responses, adjusted for instrument 
nonresponse. 



— Numbers do not include instrument nonrespondents . 
c/ 

— This represents primarily item nonresponse (i.e., failure to answer 
an item) , but also includes multiple responses, out-of-range responses, 
and inconsistent responses. 

Weighted numbers and percentages may not total exactly due to rounding 
error. 
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ERIC 
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Table 4.22 



EXPERIENCE OF UB PROJECT COUNSELORS IN 
RELATED COUNSELING POSITIONS 



A. Counseling Experience of UB 


Counselors in UB Projects 










Summer 




Academic 


Year 


Program Experience 




WN 


N- 




WN 


:, ^1 


None 


13 


.5 


160 


14 


8 


.5 


101 


c 

5 


28 


.5 


338 


19 


36 


.2 


429 


31 


2 


10 


.8 


128 


9 


13 


.6 


161 


11 


3 


7 


.3 


86 


6 


5 


.7 


68 


7 


4 


3 


.9 


46 


3 


0 


.6 


7 


1 


5 or more 
Indeterminate—^ 
e/ 

Totals^' 


9. 


.7 


115 


12 


20 


.8 


246 


16 


26. 


2 


312 


21 


14 


.6 


173 


13 


100. 


0 


1184 


84 


100 


.0 


1184 


84 



B. Number of Years Counseling Experience of UB Counselors with Minority 
Groups of "Disadvantaged Students" Prior to Work with UB 



Years Experience 




WN 


^1 


Less than 1 


57.4 


679 


40 


1-2 


24.5 


290 


24 


3-4 


8.5 


100 


9 


5 or more 


9.6 


114 


• 11 


Totals 


100.0 


1184 


84 



NOTE: Table based on responses to PIQ questions 15. a and 16. For 
approximate standard errors of percents, refer to Table 4.1, 
column K* - 

a/ 

— Percentages are based on weighted responses, adjusted for instrument 
nonresponse . 

— ^ Numbers do not include instrument nonrespondents . 
c/ 

— Category includes analysis imputations. . 

This represents primarily item nonresponse (i.e., failure to answer ■ 
an item), but also includes multiple responses, ouc-of-range responses, 
and inconsistent responses. 

e/ 

— Weighted numbers and percentages may not total exactly due to rounding 
error. 
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training in their content area. The level o£ education and training main- 
tained by the project sliaff, and their continued efforts to further this 
training and education, clearly suggest that stvdent participants in the UB 
program were under the direction of capable and qualified project personnel. 
These results are, of course, based on self-reported and unverified infor- 
matics about the staff members; however, observations made during site 
visits also indicated that the program was served by highly qualified staff 
meirbers. Moreover, progran guidelines suggest (and observed practices 
indicate that this suggestion is followed) that UB staff be recruited from 
the staff of ' "feeder" high schools and host institutions, which would 
typically produce a high level of training and formal education. 

The reported results, as well as results of interviews during site 
visitation, suggest that the UB staff possessed a good deal of practical 
experience in their professional field of work; however, much of their 
experience in working with poverty level and academic risk students seems 
to have been gained while associated wii:h the UB program. Lack of experi- 
ence with the program on the part of some staff members is understandable 
in light of: (1) the relatively short timespan that some projects had 
b ten in operation, and (2)- a program policy that suggests turnover of one 
third of the instructional staff every year. Although this suggestion of 
rotating staff avoids problems of self -perpetuating mediocrity, it also 
has potential for being counterproductive in terms of experience with the 
target population students among UB staff members, particularly in light of 
the finding that a good deal of such experience is gained only through 
association with the program. During site visitation, project directors 
expressed similar concerns. 

IV • WORK ACTIVITIES AND WORKLOADS OF UB PROJECT STAFF 

The particular activities to which the UB staff members allocated 
their working time and the extent of the functions they performed are impor- 
tant features of a national description of project staff. For this reason, 
several items of the staff questionnaire were directed to this matter. 

170 
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This section describes the ways in which the UB project directors, in- 
structors, and counselors allocated their time among project activities. 
It also discusses the extent to which instructors and counselors were 
employed by UB, the nature of their other employment, and their UB work- 
loads and instructional practices. 

A. Actual and Ideal Distribution of Tljne 

An item in all staff questionnaires^^ asked respondents to distribute 

100 percent of their UB working time among a list of activities (for both 

the 19*^3 summer and 1973-74 academic year programs) . Respondents were 

asked to give not only the actual distribution of their time, but also the 

distribution which they thought would be ideal. The results are presented 

in terms of the median percent time spent on the activities (actual or 

ideal) during the summer and academic year programs .-i^^ Although medians 

18 / 

do not possess some, of the desirable properties of means, — they are less 
affected by extreme values and for these data are considered to pro>^ide a 
more realistic description of time allocation. 

Table 4.23 presents the actual and ideal time allocation for project 
directors. As shown in the table, the single activity taking up the great- 
est proportion of the project directors* time during both the summer and 
the academic year-was general administration (budget management, staff 
supervision, report witing, etc.), requiring 40 percent of their time 
during the summer and 3.5 percent during the academic year. The next most 
time-consuming activity was counseling students, to which they devoted 15 
percent and 10 percent ot their time during the stjmmer and academic year, 
respectively. The activity to which project directors devoted the least 



Question 18 of the PDQ, 26 of the PIQ, and 28 of the PCQ, 

— The median percent of time spent on a given activity if; simply the 
midpoint of the distribution of percentages reported by the individual 
staff members (i.e., that percentage value such that half of the responses 
given are greater than that value and half are less than that value) . 

18 / 

— Unlike arithmetic averages, medcin percentage values are not con- 

. strained to add to 100 percent even though individual response did account 
for 100 percent of time. Further, the median difference of two variables 
does not necessarily equal the difference betwt.3n the respective medians 
of the variables. 
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time was instructing students (less than half a percent in each session) . 
All other activities required about 5 to 10 percent of the project directors' 
time. In general, the proportions of time taken up by the various activities 
were quite similar during the summer and academic year. These average 
results are compatible with observations made during site visitation, but 
considerable diversity of actual time allocation among projects was observed 
both during site visits and in the questionnaire^ responses. 

Actual and ideal time allocations for instructors are presented in 
Table 4.24. It is seen that in both the summer and academic year programs, 
the bulk of instructor time was spent, as expected, in teaching or tutoring 
(the median reported percentage was 50 percent for the siumner and 70 percent 
for the academic year). The only other activities to- which the instructors 
devoted a substantial proportion of their time in either session were 
counseling students and conferring with teachers and other project staff. 
The instructors spent less than three percent of their time on each of the 
remaining activities. This finding is also in agreement with observations 
and unstructured interviews with instructors during site visitation. 

The allocation of time by counselors is presented in Table 4.25. As 

expected, the activity to which counselors devoted the greatest percent of 

time, in either session, was counseling students. Individual and group 

counseling, respectively, took up 18 and 10 percent of the counselors' time 

in the summer and 20 and 10 percent in the academic year. Other summer 

activities accounting for over 9 percent of the counselors' time included 

19 / 

teaching or tutoring and conferring with teachers and other UB staff. — 
In the academic year, these two activities were not as demanding; less than 
1 percent of the counselors' time vras devoted to teaching or tutoring, and 
5 percent was spent conferring with UB staff. A broad diversity of counselor 
activity was also reported in interviews with counselors during the site 
visits; however, the proportion of time spent in actual counseling was 
generally reported as greater than the median questionnaire ro.ports. It is 



— It may be because of the presence of tutor-counselors, who worked 
primarily during the summer, among the counselor group that ''teaching 
or tutoring" accounted for this considerable median percent of counselors' 
time. 
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quite possible, however, that the inclusion of data from tutor-counselors 
(who worked primarily during the summer) has distorted the questionnaire 
results. 

To this point, discussion has focused on the median percentages of 
time that the three staff groups^ reported actually spending in a variety of 
activities. A question of. perhaps greater Interest concerns whether the 
staff members are spending their time in ways that they consider optimal. 
While some insight into the^a questions may be obtained from the reported 
values in Tables 4.23 through 4.25, differences between medians will not 
(except under unusual conditions) equal the median of individual differences. 
To investigate whether the project directo:;.- , instructors, and counselors 
allocated more (or less) time than they desxred to any activity, the median 
differences between the actual and ideal per cents were determined for each 
individual. For each respondent on each activity the difference of actual 
minus ideal time allocation was computed, and the median of these individual 
differences over staff members was then det-r-^ined. For all activities, 
across all three categories of staff, and for each program session, the 
largest median difference (found for general administration by project 
directors in the summer) was +4.6* All other median differences fell in 
the range of -2.1 to 0.5. The small median differences indicate that there 
was no trend among directors, instructors, or counselors to perceive any 
of the listed activities as requiring more or less of their time than they 
felt it should.—/ 

The absolute ranges of the individual differences were, however, 
relatively large. In most cases, the largest difference at one extreme 



20/ 

— A median difference near 0 does not indicate that all project directors 
spent their time in ways that nearly fit their ideal; rather it indicates 
that there is no consistent trend among project staff ii? viewing a partic- 
ular activity as either more demanding or less demanding on their time than 
it should be. By definition of the median, half of the project directors 
will show a differeti^ce of ideal and actual time allocation greater than 
the reported median difference and half will show a smaller difference. 
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'^'"•^ 21/ 
was "-25, and at the other, +27, — That is, for most activities in the 

list, the greatest negative difference (a staff member reporting less time 
than desired allocated to an activity) was -25 percentage points. And, 
with few exceptions, the greatest positive discrepancy (a staff member 
spending more time than desired on an activity) was +27 percentage points. 
These differences, representing the extremes of the range, were usually 
observed for very few staff members, and for nearly all activities, half of 
the staff members showed differences no greater than about +8 percentage 
points; and three-fourths exhibited differeaces no greater than +11 percent- 
age points. Therefore, not only was there no consistent trend for any 
listed activity to be regarded as requiring too much or too little of the 
staff's time, but, for most staff members, the differences found between 
actual and ideal time allocation were no larger than about 10 percentage 
points. 

In summary, project directors, instructors, and counselors all performed 
a number of diverse activities in common, especially counseling. Teaching 
was another important shared activity, principally between instructors and 
counselors. As would be expected, the greatest proportion of time within a 
given staff category was spent in activities related to that particular 
staff position (i.e., general administration for project directors, teaching 
for instructors, and counseling for counselors) . There was no consistent 
trend for any of the three staff groups to report that they were, as a 
group, allocating more or less time to any specific activity than they 
thought ideal. There were some individual staff members reporting distri- 
bution of tijr.3 among the specific activities in ways that were markedly 
different from an ideal allocation, but for the majority of staff members 
actual percent of time spent on an activity was discrepant from ideal time 
allocation to that task by no more than 10 percentage points. 



— The exceptions for directors was a range of -16 to 60 for general 
administration in the summer. For instructors there were 7 exceptions, 
with ranges of -30 to 40 for individual counseling and recordkeeping in 
the summer, and parent conferences and recordkeeping in the academic year. 
The other exceptions were summer teaching/tutoring (-45 to 65); and in the 
academic year, orientation of students/staff (-91 to 5), and teaching/ 
tutoring (-24 to 90). For counselors, the 4 exceptions included: indi- 
vidual counseling in the summer (-20 to 65) and in the academic year (-50 
to 10) ; group counseling in the summer (-60 to 20) ; and writing in the 
academic year (-5 to 35), 177 
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B. Nature of UB Employment and Other Employment of Counselors and 
Instructors 

This subsection examines the extent to which UB counselors and instruc- 
tors were employed by UB and the nature of any other employment of those 
not employed full-time with the program- Table 4.26 presents the percentage 
distribution of instructors by the number of hours they were employed by UB 
weekly. During the 1973 summer .program, over half of the instructors were 
employed full-time by UB, while in the 1973-74 academic year, over ona- 
third did not work for UB and another third were employed less than 10 
hours per week. Table 4,27 shows the nature of the other emplojnnent of the 
instructors who were not employed full-time by UB at the time of the survey 
(spring 1974). Nearl/ all had other employment, and most worked in other 
teaching positions, especially in secondary schools (37 percent) and colleges 
or universities (27 percent). Thus during the academic year, when many UB 
projects do not offer regular classes, most UB instructors were principally 
occupied in teaching in secondary or postsecondary schools. 

The situation among counselors is quite similar. Table 4.28 shows 
that during the 1973 sumiiier program, slightly more than half of the coun- 
selors were full-time employees of UB, while one-fifth were not working for 
UB. During the 1973-74 academic year, only one-fourth were working for Ui5 
full^-time, over one-fifth were not employed by UB, and nearly one-third 
were employed by UB for less than 10 hours per week. 

Of the counselors who were not employed full-time by the program at 
the time of the survey, at least half were otherwise employed, but another 
one-fifth failed to answer tbi.'^ question, as seen in Table 4.29. Of those 
who responded that they were employed, about two-thirds were employed in a 
helping profession (as counselors, psychologists, social workers, etc.). 
The 30 percent who reported that they were not employed outside of UB may 
be primarily the college students serving as tutor-counselors. 

The results discussed in this subsection are supported by certain 
findings of the site visits. Specifically, there was more full-time employ- 
ment of counselors and instructors in the summer pT/ogram t' an in academic 
year session, but some continuity of staff between the two sessions was 
maintained (typically by summer staff serving in a part-time capacity 
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Table 4.26 

EAiajT OF UPWARD Bo^J^^) employment of instructors 



Weekly Koars 
o£ Employ meat: 


1973 Sumaer 


1973-74 Academic Year 




WN 










Full- time 


31.6 


1534 


79 


5.0 


143 


7 


30-39 


8.7 


260 


14 


U. O 






20-29 


1.1 


230 


12 


0.7 


20 


2 


10-19 


12.2. 


363 


19 


2.9 


86 


6 


Less Chan 10 


2.9 


36 


5 


32. S 


975 


57 


Not ttfflployed— 


7.5 


224 


15 


37.8 


1124 


56 


Indeterminace^'^ 


9.3 


276 


10 


20.0 


597 


25 




100.0 


2973 


154 


100.0 


2^-73 


154 



NOTE: Table based on responses to PIQ question 16. For apprcxlnate 
standard errors of percents, refer to Table 4.1, coluaa F. 

a/ 

~ Percentages are based on weighted responses, adjusted for Instrument 
nonresponse . 

b/ 

~ Numbers do not include instrumenc nonrespondr ^ ns . 
c/ 

~ This category includes persons who were employed during only one 
of the two sessions. 

d/ 

~ This represents primarily item nonresponse (i.e., failure to answer 

an item), but also includes multiple responses, out-of -range rcisponses, 
and inconsistent responses. 

e/ 

~ Weighted nuabers and percents may not total exactly due to rounding 
error . 



Table 4.:7 

OTHER EMPLOntEIiT OF ^TPWARD BOUND INSTRUCTORS NOT EMPLOYED 
FULL-TIME DUi;...:H"G "niE 1973-74 ACADEMIC YEAR 







Other Employment 




WN 










No other employment 

Teachers, elementary ichool 

Teachers, secondary school 

Teachers, vocational/technical school 

Teachers, college/university 

Teachers, oche.r 

Other 

. c/ 
Indeterminate— 


2.7 

3.9 
36.8 

0.5 
27.1 

7.1 
10.9 
10.9 


80 
117 
1094 

16 
806 
212 
323 
326 


5 
5 
56 
1 
44 
U 
20 
12 


Total 


100.0 


2973 


154 



NOTE: Table based on response.'^ to PIQ question 17. For approximate standard 
errors or percents, refer to Table 4.1, column F. 

- Percentages are based on weighted responses, adjusted for 'Instrument 
nonresponse . '■ 

b/ , 

Numbers do not include instrument nonrespor.dents . 

sJ 

This represents . :".'.^.rily item nonresponse (i.e., failure to answer an 
item), but also i->r\\u - a multiple responses, out-of-range responses, and 
ineons is t en t r es . : . 

d/ 

Weii^hted nur;;: •. ^.nd percentages nay not total exacclv cue to rbund-fng 
error. 
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Table 4.28 

EXTENT OF UPWAXD BODKD EMPLOYMEST OF COUNSELORS 



Weekly Hours 


1973 


Susioer Froi^aa 


1973-74 Acadenic 
Year Procram 


of EnploymenC 


a/ 


WN 










Fall- time 


52.8 


625 


43 


24.4 


289 


27 


30-39 


13. S 


163 


9 


5.4 


64 


2 


20-29 


2.8 


33 


4 


2.0 


23 




10-19 


4.5 


53 


3 


6.3 


75 


5 


Less than 10 ^ 
c/ 

Not employed— 


O.A 


5 


2 


30.2 


358 


23 


20.1 


238 


22 


21,7 


257 


17 


Ind e t emiaat e^' 


5.6 


66 


1 


9.9 


U7 


8 


e/ 

Total - 


100.0 


1184 


84 


100.0 


U84 


84 



NOTE: Table based on responses to PCQ question 17. For approximate 
standard of errors of percents, refer to Table 4.1, Column K. 

a/ 

~ Percentages ara based on weighted responses, adjusted for instrument 
noaresDonse. 



c/ 



Nusibers do not include instrtunent nonrespondents . 



This category includes persons who were employed during only one of 
the tvo sessions. 

fi/ 

— This represents primarily item nonresponse (i.e., failure to answer 
an item), but also includes multiple responses, out-of- range responses, 
and incotisistent responses. 

e/ 

— Weighted numbers and percentages may not total exactly due to 
rounding error. 



Table 4.29 

0TH2R EMPLOYMENT OF UPWARD BOlfiO COUNSELORS NOT EMPLOYED 
FULL-TIME DURING THE 1973-74 ACADEMIC YEAR 



Other Eu:pi3\'Tr.enc 


i -a/ 

1 " 


i 


: 

b/ 


No employment outside Upward Bound 


29.7 


351 


13 


Employed in "helping" profession 








(counselor, psychologist, social 








worker, etc.) 


31.8 


377 


32 


Other than helping profecsion 


18.1 


215 


12 


Indet enainateS^ 


20.4 


242 


22 


total 


100.0 


1194 


84 



NOTE: Table based on responses to PCQ quastion 18. For approximate 
standard errors of percents, refer to Table 4.1, Column K. 

a./ « 

Percentages are based on weighted responses, adjusted for instrument 
nonresponse . ' 

Numbers do not include Instrument nonrespon denjLS ■ 

c/ 

— This represents primarily item nonresponse (i.e., failure to answer 
ari iten) , but also includes multiple responses, out-of-range responses, 
and incionsistent responses. 

d/ 

— Weighted nucbers and percentages may not total exactly due to rounding 
error. 
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during the academic year). Furthermore, the part-time staff members employed 
by UB during the academic year seemed to be recruited primarily from the 
ranks of those already employed in similar occupations • 

Activities and Workloads of Ins^:ructors 

This subsection examines the workloads of the UB instructors and their 
instructional practi' es. The percentage distributions of the number of 
classes taught by full-time and part-time instructors in the two sessions 
of the program are presented in Table 4.30. During the 1973 summer pro- 
gram, full-time instructors taught an average of 2*9 classes, while part- 
time teachers averaged only slightly fewer classes, 2.4. During the academic 
year (1973-74), full-time instructors taught an average of 2.2 classes 
(although this statistic Is based on only 7 respondents and thus has a 
large standard error) ; part-time teachers taught an average of 2,6 classes, 

- -The distribution of number of classes taught by full-time and part- 
time instructors during both summer and academic year sessions reflects 
considerable diversity in instructors' teaching loads. Almost 13 percent 
of the full-time summer instructors reported teaching one class or less 
while over 18 percent of the paxt-time instructors were teaching four or 
more classes during the same period. While baspd on such small numbers 
that the percentages tend to be unstable, the situation seems to be the 
same during the academic year. Such results seem to reflect the previous 
finding regarding allocation of instructor time to noninstructional 
duties (see previous subsection) . 

Table 4.31 examines the extent to which instructors (part-time and 
full-time) reported using selected instructional methods in their UB teach- 
ing. Of the practices incJ.uded, the most popular was individualized instruc- 
tion. Nearly all teachers used it to some degree, and over half reported 
that they used it to a great extent. Other common practices which were 
reportedly used to a ''great extent'' by 30 percent or more of the instructors 
were seminars or clasi:. discussion, open classrooms, and nongraded classes. 
In contrast, relatively little use was made of competitive and noncompetitive 
grading systems, team teaching, or grouping students by ability. Smaller 
proportions reported using those practices, and among those employing them, 
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most reported a small or moderate extent of use* Thus, consistent with the 
UB goals of motivating studenr.s to learn and strengthen their self-image, 
the majority of the teachers gave individualized instruction, did not grade 
students competitively, and often taught in open classrooms; however, they 
also relied heavily on the more traditional methods of lectures and class 
discussions, and to a lesser extent, on the use of instructional media and 
programmed instruction. 

D. Activities and Workload of Counselors 

This subsection discusses the workload of tzhe UB Cv-^.^xnsiiiors (in terms 
of counseling contacts per week, length of counseling sessions, and number 
of sessions per student) and the types of counseling conducted. Table 4.32 
reports the median percentages of time, out of cotal student-contact titue, 
that counselors devoted to various student concerns or issues during the 
1973 summer and 1973-74 academic year programs. The median proportions of 
the student-contact time spent on a particular issue were in general quite 
similar during the two sessions. Although standard errors were not cotnputzed 
for these medians, the data indicate that more time was spent on matters 
related to post^econdary entry, high school prrblems, and financial problems- 
during the academic year than in the summer. — ' In both sessions, entry 
into four-year colleges, personal and family problems, social and situational 
problems f hi^.h school academic problems, and financial concerns accounted 
for notable proportions of the counselors' student-contact time. 

Table 4.33 presents the percentage distributions of full-time and 
part-time counselors, by the average number of students counseled per week, 
during the 1973 summer and 1973-74 academic ;^ar programs. Except for 
group counseling by full-time counselors, >;i: r^; students were counseled per 
week during the summer than during che acadc^iilc year. During the summer, 
the median number of students counseled per week by full-time and partz-tzime 
counselors, respectively, were 16.3 and 16,2 in individual sessions, and 



— The lesser Involvement with financial concerns during the summer pro-- 
gram may arise f"com the situation often discussed during the sit?, visits 
that students who very much need to earn money do not enroll In "he summer 
program. 
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Table 4.32 



MEDIAN PERCENTAGE OF COUNSELING TIME SPENT ON 
VARIOUS STUDENT CONCERNS. 



Areas of Counseling 


xy / J oummer 


1973-74 Academic 
lear 


Career vocati 'U guidance, jobplace. 






o t* o 


/. Q 
A , O 


5 J, 






14.5 . 








* uo Lo cv-,iJnuci-L jr cCLucaujuon ounez. unan 






2 or 4 year collei^a 


0, 5 


3.1 


Personal & family problems 


10,4 


10.1. 


Social/situational problems 


9,8. 


8.5 


High school attendance 






High school academic choices 


4. 8 


5.0 


High school academic problems 


9.8 


10.0- 


-Financial concerns 


5. 1 


9. 6 


Other 


0. 3 


0.2 


Number of cases (weighted )- 

Number of cases (unwaighted)^^ 
1 


771 
56 " 


781 
63 



NOTE: This table is based on responses to PCQ question 24. Medians 
are based on weighted responses, adjusted for instrument non- 
response . Adjustments for indeterminate responses to each "item 
(item nonresponse, multiple or inconsistent responses) were not 
made; reported values were computed for subset of determinate 
responses only and were further restricted to the counselors 
responding that they did counseling in each session. Standard 
errors were not computed for these data. 

a/ w J • 

— Hedian percents are not constrained to sum to IOC, even though 
individuals' responses did account for 100 percent of their time, 
b/ 

— The number of respondents on which median values were computed. 
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Table 4.33 

^^^EilS OF DlrFERE^^ STlTDEIITS COUZISELED VZR WEEK i:^ INDlVIPUAt 
\:vD GKOU? COU:;srtlNG 5ESSX0NS BY FULL- TIME .\ND ?ART-TI>£S COL^JSELORS 













Individual 


Coiinselini5 








Group Counseling 




Szudencs Cdimseled 
Per Week 


Full-cl3e Counselors 


Part-ticie Counselors 


Full-cine Counselors 


Part-ti 


ae Cour 


iselors 


^a/ 




















VN 














Suinaer (1973) 


























None 














5.1 


32 


3 










28.5 


178 


9 


19.6 


50 


3 


30.3 


139 


9 


11.4 


29 


3 


10-19 


30.4 


190 


16 


31.8 


SI 


7 


16.5 


103 


5 


36.2 


92 


4 


20-29 


4.2 


26 


3 


22.0 


56 


2 


12.2 


76 


7 


9.0 


23 


2 


3CK39 


13.3 


83 


7 


5.5 


14 


1 


5.3 


33 


3 


5.5 


14 


1 


40-49 


S.5 


53 


2 








6.9 


43 


4 


5.1 


13 


1 


50-59 


8,2 


51 


2 








1.3 


8 


1 


1.9 


5 


1 


60-69 


2.2 


14 


2 








1.1 


7 


1 








70 or nsore 














12.8 


ao 


6 








c/ 

Not applicable— 


2.0 


12 


i. 


17.6 


45 


3 


3.2 


20 


n 


27.2 


69 


4 


d/ 

loa e t ermi^ia c e^ 


2.7 


17 


1 


3.5 


9 


1 


5.1 


32 


2 


3 5 


9 


i 


Total— ^ 


100.0 


624 


43 


100.0 


255 


17 


100.0 


523 


43 


100.0 


254 


17 












Academic Year (19/3-74) 


























None 


3.1 


9 


1 








'5.5 


16 


2 


18.3 


95 


3 


Fever than 10 


44.3 


128 


11 


69.4 


361- 


17 


31.6 


91 


11 


33.3 


173 


8 


10-19 


3^1.4 




10 


10.4 


54 


6 


5.2 


15 


1 


3.8 


20 


2 


20-29 


3.5 




1 


1.5 


8 


1 


27.2 


79 


5 


9.4 


45 


4 


.30-39 


2.1 


6 


1 


5.S 


30 




2.8 


S 


1 


8.1 


42 


4 


40-49 














8.7 


25 


1 








50-59 














3.6 


25 


3 








60-69 


4.5 


13 










S.2 


24 


2 


3.6 


19 


3 


70 or aore 

Not applicable^^ 














2.1 


6 


1 














5.0 


26 


2 








9.7 


51 


3 


Ind e c e ra ina c 


4.1 


12 


1 


7.9 


41 


4 








14.0 


73 


5 


: ^ 


100.0 


289 


27 


100.0 


520 


32 


100.0 


289 


27 


100.0 


520 


32 



NOTE. — — ^w^^, — w« ^, Av^x 4ucifi.Auii nxj,KL tu laoxi i», i tor approximate 

standard errors oi percencs; for fuU-titte sutouiar counselors, rarer to ccluam J; for pari-tUae summer coun- 
^v.lors, refer to column H; for full-time academic year couaaalori:. refer to coitinn G; foe part-time acndemic 
year counselors, refer to coluaa I. 

rercentag^is are based on weighted responst^s, adjusted for instrusrent nonrgsponsa . 

- JTuflbers do not include Ins.tnraent rio:jre spc ud en c s . 

- Counselors who responded thac they did not perform coun&iiiing during this session are included as "not 
applicable'. 

- rnis represents prlaarily Iteta noaresponse (i.e., failure to answer an itea) , but nUc .ncludes aultiPle. 
responses, out^f-ran^^e responses, and inconsistent resfionses. 
e/ 



e/ 

— Weighted nuribers and percentages aay not tocal eJcactly due to rounding trror. 
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17.3 and 16,4 in groups. During the academic year, the median numoers of 
students per full-time and part-time counselor, respectively, were 10.1 and 
6,3 in individual counseling, and 22.9 and 3.8 in group counseling. The 

h: .?i.ar load in group counseling by full-time counselors during the acadeiuic 
year may be inflated by group meetings held at high schools.. 

Table 4.34 displays the percentage distributions of full-time and 
part-time counselors, by the average length of counseling sessions in 
individual and group situations, for the 1973 summer and 1973-74 academic 
year programs. In all cases, full-time counselors reported holding some- 
what longer sessions than' part-time counselors* But the average session 
length, compared within full-time or part-time status and within individual 
or group counseling, did not differ between the summer and academic year 
programs. Full-time counselors reported median lengths of individual 
counseling sessions during the summer and academic year to be 28.8 and 30,2 
minutes » respectively; the analogous medians for part-time counselors were 

22.4 and 21.4 minutes. The median lengths of group counseling sessions by 
full-time counselors for the summer and academic year were 42.0 and 39,0 
minutes, respectively. The analogous sp.ssion lengths for part-time 
counselors were 26.9 and 26.0. 

Table 4.35 presents the percentage distributions of full-time and 
part-time counselors, by their estimates of the average number of sessions 
they had counseled the same UB student during the 1973 summer and 1973-74 
academic years. Most full-time and part-time counselors reported that they 
saw a student in two to four counseling sessions during both the summer and 
academic year. The median numbers of sessions held with a student in the 
summer, by full-time and part-time counselors were 3.7 and 2.5, respectively. 
The analogous medians in the academic year were 3.7 and 3.9. 

Because Tables 4.32 through 4.35 were based on the counselors' own 
estimates of their average workloads and average distribution of time on 
various kinds of activities, they may be subject to considerable error. 
But assuming that the estimates are reasonably accurate in the aggregate, 
they present a picture of counselor's busy in other activities besi^^es 
counseling (which is consistent with other results reported in this section), 
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labia 4.35 



AVSUGE OF COtr^SELI^JG SESSIONS H£'-D WITH A 

'-rVSI uT.^ARD BCtmB STUDEKT 



Average Number of 
Counseling Sessions 


Full- 


ciae Coimselors 


Pare- 


Izz::^. Counselors 




WN 






WN 


















One 


1.2 


8 


1 


— 


— 


— 


Two 


16.0 


100 


6 


18.5 


47 


3 


Three 


20. 9 


131 


8 




102 


5 


Four 


14.0 


87 


9 


8. 7 


22 


2 


Five 


13. 1 


82 


5 




8 


1 


Six 


10.5 


66 


4 


c c 
3. 5 


14 


1 


Seven 


7.3 


46 


4 








Fight or core 


13- 7 


86 


4 








Not applicable^^ 
Ind e t erai na t 


3.3 


20 


2 




52 


4 






■■^ 


3-5 


9 


1 


Total- 


100.0 


626 


43 


100.0 


254 


17 
















One 


2.6 


8 


2^ 


8.3 


43 


2 


Two 


9.7 


28 


3 


1.5 


8 


1 


Three 


14.1 


41 


6 


19.4 


101 


7 


Four 


36.0 


10'* 


7 


18.8 


sr, 


5 


Five 


10.1 


29 


3 


4.8 


25 


1 


Six 


2.0 


6 


1 


5.4 


28 


*> 


Seven 














Eight or more 


25.5 


74 


6 


32.1 


167 


10 


Not applicable- 








5-6 


29 


2 


Inde terniinate^^ 








i.O 


21 


2 


Totai-^ 

1 _ . 


100.0 


289 


27 


0 


520 


32 



NOTE: Tabled based on respoiiaes to ?CQ questions 17 and 27. Refer Co Table 
4.1 for app'ioxinate standard errors of percsnca; for full-cine suianer counselors, 
refer to colui^n J; for rart-Cice summer counselors, raf«>r Co column H; for 
full-Ciira acadeaic year counselors, rater co column G; ca. part-time academic 
year counselors, refer Co column I. 

Percentages are based on weighted responses, adjusted for InsCTumenC. 
ncaresponse . 
b/ 

— Numbers do not i:iclude instrument nonrespondencs. 
c/ 

— Counselors ^sho responded that they did not hold cour 3eling sessions are 
included as "not applicable". 

This represents primarily item nonresponse (i..e^- » failure to answer an itam) , 
but also includes ctultiple responses, out-of-range responses, and inconsistent 
responses, 
e/ 

— Weighted nuabars and percentages cay not total exactly due Co rounding 
error. 
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and within their counseling function, rather harried. Full-tinie counselors 
in the 1973 summer, for example, estimated that they spent a median of 
somewhat less than hnxf an hour (28 minutes) on each individual counseling 
session, arid that they saw 16 students per week in such i^essions. 

V. UB PROJECT STAFF ATTITUDES TOWARD 
EDUCATION .iND UB STUDENTS 

A, Goals of Education 

An item conuaon to all staff questionnaires— requested respondents to 
impose a weak ordering, within their philosophy of education, on 14 educa-- 
tional goals. These data were analyzed, after certain response imputa- 
tions, — and are presented in Tables 4.36 through 4.38 for project direc- 
tors, instructors, and counselors, respectively. For purposes of presenta- 
tion,, the weak orders were grouped into three re^sponse categories — "more 
important^' (cop two categories of ordering), "moderately important" (middle 

category of ordering) , and "less important" (lowest two categories of 

^ • ^ 25/ 
ordering) . — 

The tables show that 84 percent, "'51,.percent, and 53 percent of the 
directors, instructors, and counselors, respectively, rate^ giving th.^ 
student solid grasp of fundamentals as being more important. Helping the 
student feel important as a person was rated more important by 61 percent, 
77 percent, and 80 percent, respectively. Developing the student's enthusiasm 
for learnir g was also rated by the members of the three staff positions as 
a more important goal of education. There is agreement among the three 



23/ 

— Question 23 of the PDQ, question 29 of the PIQ, and question 30 of 
the PCQ (see Appendix D) . 

24/ ^ 

— Responses to this item were forced into symmetric distribution sujh 
the.:: the respondent ranked 2 items as "most important," 3 items as "more 
import mt," and 4, 3, and 2 items as "important," "less important," and 
"least important," respectively. Imputations involved assigning the average 
of omitted rankings to subitem nonresponses and forcing responses into the 
desired distributions, when respondents failed to follow the imposed 
ordering scheme. These imputations are defined in detail in Appendix E. 

25/ 

The labels assigned to responses are, of course, relative to the other 
educational goals presented and do not reflect importance in an absolute 
sense. 
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Table 4.38 

UB PROJECT COUNSELORS. RATINGS OF GOALS WXTHXN THEIR PHILOSOPHY OF EDUCATION 



Educational GOctIs 



Help student feel important 

Help student learn to make choices 

Develop expectations of success 

Develop student's self-concrol 

Increase student's sense of control 
over his envicomnent 

Develop enthusiasm for learning 
Solid grasp of fundamental skills 
Develop language skills (for those with 
non-English speaking backgrounds) 

Develop student's sense of ethnic 
pride 

Involving parents 

Develop student's ability to 
Work cooperatively with others 

Develop student's respect for 
others 

Increasing student's effectiveness 

in dealing with authority figures 
Improving study habits 



Z^'^ KN 



dO.O 
54.1 
49.5 
12.5 

26.1 
68.1 
53.3 

10.7 

25.0 
10.9 

28.7 

29.3 

10.8 
27.7 



948 
641 
588 
148 

309 
807 
631 

127 

298 
129 

341 

3^6 

128 
328 



Moderately Importaat^^ 



A/ 



66 
54 
44 

13 ^ 

23 
55 
49 



17 
13 

20 

22 

9 
19 



12.6 
28.1 
36.4 
28.5 

21.6 
22.7 
29.5 

24.7 

26.1 
25.0 

45.1 

30.5 

27.0 
47.8 



WN 



150 
334 
432 
337 

257 
269 
351 

292 

309 
296 

533 

361 

321 
567 



9 
18 
25 
28 

19 
18 
20 

21 

22 
25 

40 

28 

20 
44 



^Less Impo rtant^ 



1 I I i_ — f i ! 1 I 

NOTE: Table based on responses to FCQ question 30. Imputations were performed on these d^ta On ^ fiL nn.^ 

scale, more important represents 1^2.49; important reoresents 2 50 3 sn- V ! . five-point 
3.51-5.0. For approximate standard errors of "^rcenL'^re^^r Sbif 1^001^^^ 

tithif rounding error'"'"' nonresponses; thus percentages add to 93. add tb 1163. and N add to 82. 

- Percentages are based on w.^ighted responses, adjusted for instrument nonresp on... 

— Numbers do not include inuytrument nonresoonse. 



5.5 
15.9 
12.2 
57.1 

50.4 
7.4 
15.4 

62.8 

47.1 
62.3 

* 24.3 

38.5 

60.4 
22.7 



WN 



64 
189 
144 
677 

597 
87 
131 

742 

557 
738 

289 

455 

715 
261, 



7 
10 
13 
41 

40 
9 
13 

54 

43 
44 

22 

32. 

53 
19 
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staff categories that increasing the student's ef f ectiven-ass in dealing 
with authority figures was not too .important. Only 8 percent of the 
directors, and 11 percent of the instructors and counselors rated this goal 
as more important. Clearly, the tables indicate an extremely high degree 
of agreement and similarity in the staff members' aggregate ratings of the 
goals* 

To measure the relation among the three rankings of the 14 goals of 
education, the median of the weak orderings were used to describe the 
aggregate order of ijnportance of the goals within each staff category.—^ 
The medians were Lhen ranked from lowest to highest • Table 4.39 presents 
the ranked median orderings of goals of education by the project staff. 
When three sets of rankings are obtained, one may determine the association 
among them by using the Kendall coefficient of concordance.—^ As a tech- 
nique designed to determine the agreement among several judges or the 
association among several variables, it provides a measure of association' 
based upon rankings. Kendall's cc-afficient of concordance for the three 
rankings given in Table 4.39 is .90, and a coefficient of this magnitude 
would occur by chance less than 1 time in 1,000 if, in fact, there was no 
relationship. Such strong agreement among the proj'ect directors, instruc- 
tors, and counselors concerning goals of education suggests that UB staff 
members were similarly directed concerning program goals. 

Although the data presen ted reflects on national agreement among staff 
categories, the same strong agreement among staff as to program mission was 
observed at the project level during site visitations. Generally, staff 
members agreed that the more important goals of education were developing 
the student's enthusiasm for learning, helping students to feel important, 
and providing students with a solid grasp of fundamental skills. 



26/ o^u 

The median is that value in the range of ordered responses to a vari- 
able such that 50 percent of the respones are greater than the median and 
SO percent are smaller. The medians in this case were obtained by assigning 
the values of 1 through 5 to the 5 original ''importance" categories, from 
''most important" to "least important." 

27/ 

A brief discussion of the Kendall coefficient of concordance is avail- 
able in Appendix G. More detailed descriptions can be obtained from any 
introductory text on nonparametric statistics. See, for example, S. Siegal, 
Nonparametric Statistics for the Behavioral Sciences . New York: McGraw- 
Hill, 1956. 
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B. Perception of UB Students 

28/ 

An item in each staff questionnaire — requested respondents to rate 
the UB students in their project along several dimensions. The results are 
presented in Tables 4.40 through 4.42. Only students' peer relations and 
student creativity were rated good to excellent by more than half of the 
project directors, instructors, and counselors. Although there was variation 
among the various staff categories, project participants were seen as being 
good to excellent in general academic ability by from about one-fourth to 
one- third of the staff members. Student attitudes toward school and toward 
authority were generally seen as being only poor to fair, though .slightly 
more average in the eyes of instructors. (The instructors may have had a 
more realistic reference point for such ratings as a result of teaching 
other students in either the high school or college.) 

To examine the relationship among ratings by the three staff cate- 
gories, the median ratings were determined and ranked to describe the order 
of the ratings of students along different attribute dimensions.—^ Table 
4.43 presents the ranked median ratings of students for each staff category. 
Kendall's rank correlation coefficient (tau) provides a measure of the 
degree of association or correlation between two sets of ranks 



30/ 



The 



Kendall tau value was .71 for rankings by directors and instructors, .60 
for directors and counselors, and .90 for instructors and counselors. None 
of these described relationships would occur by chance more than 5 times in 
1,000 if, in fact, no relationship existed. 

Project directors, instructors, and counselors strongly agree in the 
order of aggregate ratings of the several attributes of UB students. It 
can be seen from Table 4.43 that all three staff categories perceived the 
students to be most proficient in peer relations and creativity, and 
22 j ' ' ' 

— Item 34 of the PDQ, item 35 of the PIQ, and item 34 of the PCQ (see 
Appendix D) . — 

29/ 

— The medians were based on a scale of 1 (for "poor") to 5 (for "excellent"). 
30/ „ 

— Because the student attribute of "responsibility" was omitted from the 
instructor's questionnaire, a coefficient of concordance was not calculable. 
A brief discussion of Kendall's tau is given in Appendix G. More detailed 
discussion can be obtained in introductory texts on nonparametric statistics. 
See, for example, S. Siegal, Nonparametric Statistics for the Behav ioral 
Sciences , New York: McGraw-Hill, 1956. " ' 
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student general academic ability was rated around average by all staff 
categories. Student attitudes toward authority and toward school were seen 
by project directors, instructors, and counselors as ranking lowest, but 
student attitude toward lire was ranked high. All three types of staff 
also perceived the students' self-concepts to be relatively poor. It is 
interesting that the students, as perceived by the staff, showed positive 
outlooks toward life, but negative attitudes toward school and authority; 
yet the staff also seemed to agree that increasing student effectiveness in 
dealing with authority figures (Tables 4.36 through 4.39) was of relatively 
low importance, as compared to other educational goals. 

C. Instructors' Perceptions of the Importance of Several Aspects of 
Instruction 

Table 4.44 shows how instructors perceived the importance of different 

aspects of teaching as determined from a question requesting them to 

inpose a weak ordering of the relative importance of fifteen aspects of 

their teaching. For the purpose of presentation, the weak orders have been 

grouped into three response categories: "more important,'* "moderately 

31/ 

important," and "less important." — The table shows that encouraging the 
students to become involved was rated more important by 60 percent of the 
project instructors. Both giving students praise and affection and answer- 
ing students' questions were seen by more than 50 percent of the instructors 
as being more important. Perceived as less important by project instruc- 
tor's were the use of disciplinary measures to discourage inappropriate 
bel-.avior (82 percent), and using rewards to shape behavior (69 percent). 
Also seen as not very important were establishing a clear time structure 
and working with parents (rated more important by only 6 and 4 percent of 
the instructors, respectively). 

Generally, project instructors viewed such aspects of teaching as 
encouraging the students to become involved, talking with students, and 
encouraging the students to make choices as being of most importance in 



— The groupings were obtained in a manner analogous to that used with 
staff members' ordering of educational goals, which has been described in 
subsection A. 
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their teaching. The instructors viewed their instructional activities in 
the same light as they viewed educational goals. For example, as seen 
earlier in Table 4.37, 77 percent of the instructors perceived helping the 
student feel important as being more important, and 53 percent thought that 
helping the student to learn to make choices was more important. Thus, the 
educational philosophy of the instructors (which is very similar to that of 
other staff members) appears to be congruent with their ideas of the important 
aspects of instruction in the UB program. 

VI. SUMMARY 

This chapter has examined a large number of attributes of the staff 
members of regular UB projects (excluding veteran and demonstration projects) 
in coterminous United States during program year 1973-74. The national 
estimates of the characteristics and activities of staff members, were" 
based on data gathered in survey questionnaires, which for the most part, 
vare not verified with other data sources. Major topics addressed in this 
chapter were the demographic and background characteristics of the UB * 
project directors, instructors, and counselors, their training and experi- 
ence, their UB activities, and their attitudes toward educational programs 
and their students. ' A table of generalized standard errors was provided to 
aid in interpretation of questionnaire results, and impressions gained 
during site visitation were used to augment and aid in interpretation of 
the tabular data. 

Although project directors as a group were slightly older than instruc- 
tors and counselors, most staff members were young (age 35 or less). 
Nearly all project directors were male, while over half of the instructors 
and counselors were also male. The greatest proportion of project directors 
were black (47 percent), while the greatest proportions o£ instructors and 
counselors were white (55 and 42 percent, respectively). These ethnic and 
sex representations are not proportional to the ethnicity representation of 
UB students, who are predominantly black (by about 60 percent) and female 
(about 55 percent) . 
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Most staff members repoi ted having lived in cities during their youth * 
(through the high school years), and even more reported residing in cities 
for most of their lives since high school. The staff reported their parents 
as being moderately well educated, their fathers as being predominately 
laborers or service workers, and their mothers as being primarily homemakers, 
laborers, or service workers. A sizable minority of fathers-and mothers, 
however, were reported to hold professional or managerial positions. Since 
a staff member with a background similar to the population of students 
served bus the potential for a better understanding of those students, 
there are arguments for a better matching of staff and student background. 

In general, all three types of UB staff were found to be well trained, 
with considerable experience in their professional fields, but with less 
previous experience in working with disadvantaged students. Among project 
directors, 75 percent reported having obtained an advanced college degree, 
as did 68 percent of the instructors and 48 percent of the counselors. 
About a third of the members within each of the three staff categories 
reported that they were enrolled in continuing formal education at the time 
-^of the survey. Academic course work on the part of instructors and counselors 
was in their professional area. Reported results also indicated that UB 
staff members had gained a good deal of practical experience in their 
professional field; hvwever, in the majority of cases, their experience in 
working with disadvantaged students had been gained primarily as a result 
of their work with the UB program. 

Over half of the instructors and counselors were employed full-time by 
UB during the 1973 summer, whereas less than a quarter were employed full- 
time during the 1973-74 academic year. At the time of the survey (spring 
1974), a large proportion of those not employed full-time by UB were other- 
wise employed, primarily in teaching and helping professions. The staff 
reported heavy workloads -which included a number of diverse functions. 
Some of the functions, especially teaching and counseling, were shared by 
all three types of staff. Some staff members, saw the allocation of their 
time among various activities to be quite discrepant from what they should 
ideally be doing. There was no consistent trend, however, for any of the 
three staff groups to report that they were allocating more or less time 
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than desired to any of a number of specified functions, and about two- 
thirds of the staff saw their time actually allocated in ways that were 
within 10 percent of what they thought would be ideal. 

Both full-time and part-time instructors reported teaching from two to 
three classes, on the average, during both the summer and academic year 
program. This lack of differentiation in class load for full- and part- 
time instructors is pr .action of the diversity of tasks that 
instructors reported th UB program philosophy, ir instruc- 
tors used individualxiic .actional methods, taught in open - .oSrooms, 
and did not use competitive grading systems; however, the instructors did 
rely heavily on some of the more traditional methods. 

Counselors reported a fairly heavy counseling workload on the average. 
Full-time counselors reported counseling slightly fewer than 20 students 
per week in the summer and slightly more than 10 students per week in the 
academic year, in individual sessions alone. In group sessions, full-time 
counselors saw, on the average, about 20 students per week in the summer 
and about 25 per week during the academic year. Part-time counselors 
reported somewhat lighter loads. The area of couns''iling to which both 
full- and part-time counselors devoted the greatest percent of their time 
during both summer and academic year programs was four-year college entry. 

Among the three staff categories, staff members were in agreement: 
concerning educational philosophy, agreeing that developing students' 
feeling of importance, enthusiasm for learning, and fundamental skills were 
the most important educational goals. The staff members were also in 
agreement in their views of the UB students, rating them highest in peer 
relations and creativity, and lowest in self concept and their attitudes 
toward school and authority. It is interesting to note that while the 
staff rated UB students as poorest in terms of their attitudes toward 
school and authority, they also reported that the goal of improving the 
students' attitude toward authority as one of their least important edu- 
cational goals. 
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Chapter 5 

Characteristics of Upward Bound Projects 



I. GENERAL 



The purpose of Chapter 5 is to describe the structure and function of 
UB projects in the coterminous Unites' Statp program year 1973-74. The 

unit of analysis is the project, rather than individual staff members. In 
the previous chapter, characteristics of b^aff members were described, 
based on individual members' responses, but, in the present chapter, char- 
acteristics of projects, as represented by Responses of staff members 
within each project, will be described. To create the required project 
units of analysis, responses of counselors from a given project were aver- 
aged to form one value for all counselors in that project. Answers of 
instructors in a project were similarly treated to yield one mean value .--^ 
Because each project had only one director, no such aggregation was necessary. 

In this chapter, more than any other, impressions from site visits 
will be presented. While the questionnaire data can stand alone, inter- 
views conducted and observations made during site visitations provided data 
which directly relate to project structure and function and which may be 
used to provide insights not possible from the responses to the structured 
questionnaire items. Certain aspects of project operation and certain 
unique practices had not been anticipated during instrumentation, and were, 
therefore, not covered by the questionnaires. Other aspects of project 

— ^ Since sampling weights were identical for all the counselors within a 
project, weighted and unweighted means yield the same value. The weights 
for all instructors in a project were also identical. The use of a measure 
of dispersion, in addition to the average response, was anticipated to 
investigate a different set of questions, to study the extent to which 
instructors or counselors in the same project varied in their answers to 
the same questions, as measured across all projects. In projects where 
only one instructor or counselor responded to an item, there was no vari- 
ability. Hence, a measure of within project variability could.be computed 
only for projects with at least two respondents of the same staff category 
to an item. Because only about half of the projects had more than one 
responding counselor, a measure of within project variability was not 
available for a sufficient number of projects. Such a measure was computed 
for instructors and analysis was undertaken, but did not reveal any note- 
worthy patterns. Hence these results are not presented. 
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operation which had been anticipated were not covered in the staff instru- 
ments in the interest of maintaining instruments of manageable size. 

Nonetheless, these aspects of the UB program were observed in the UB 
programs that were visited, and they will be reported to give a flavor to 
the program description which is not possible from the questionnaire 
responses alone. It may be argued successfully that the infonaation gained 
during site visits provides an unrepresentative picture of the program, 
since with such a small sample size (15 projects) it is most unlikely that 
the visited projects are representative of the population. It should be 
pointed out, howe" that qua;Stionnaire results also reflect a bias, 
namely the bi" ujl le selection which was introduced during question- 

naire developmi items included in the various staff questionnaires 

reflected what the RTI staff had determined a priori to be the important 
aspects in describing program structure and operation. During the site 
visits, the importance of most of these aspects was verified, but it also 
became evident that some other unmeasured aspects were equally or more 
important. The mix of results presented in this chapter is therefore seen 
as a healthy one, but to avoid reader confusion, site visit results will be 
clearly stated as such, when cited. 

The generalized standard errors to be used for most of the question- 
naire results reported in this chapter and an example of how to use them 
are given in Table 5.1. The standard errors for project directors' responses 
are the same as those found in Table 4.1, but for reader convenience, they 
are reproduced here. 

II. OVERVIEW OF PROJECT OPERATION 

Prior to presentation of questionnaire data, an overall picture of 
project operation will be presented for the reader who may not be familiar 
with all aspects of the program as implemented at the project level. This 
overview is drawn exclusively from the site visit observations and unstruc- 
tured interviews with project staff and students during those visits, but it 
is compatible with questionnaire data collected in this study and with 
information routinely maintained by USOE. 
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Table 5.1 

APPROXIMATE STANDARD ERRORS OF ESTIMATED PERCENTAGES FOR 'CHAPTER 5 



Row 


Estimated 


Estimated Standard Error (in percentage points) 


Percentage 


A 


B 


C 






(Directors) 


(Instructors) 


(Counselors) 


1 


5 or 95 


2 3 




3.2 


2 


10 or 90 


3.9 


A 9 


4.4 


3 


15 or 85 




5. 0 


5.3 


4 


20 or 80 


6.0 


5.6 


5.9 


5 


25 or 7S 


6.6 


6.0 


6.4 


6 


30 or 70 


7.1 


6.4 


6.8 


7 






6.7 


7.1 


8 


. ^i. 60 


7.7 


6.8 


7.2 


9 


45 or 55 


7.8 


6.9 


7.4 


10 


50 


7.8 ~ 


7.0 


7.4 



NOTE: This table contains estimates of approximate standard errors applicable 
to the majority of estimated percentages contained in Chapter 5. This table was 
constructed to provide a general order of magnitude of the sampling errors of 
estimated percentages, and is based on the results of a number of different 
sampling error calculations. The formulas and procedures used in thesa calcu- 
lations are detailed in Appendix B. 

To use the table to determine the approximate sanr ' ,g error for an estimated 
percentage ona must first identify the appropriate :f and column to use. 
Select the tcw that most mrarly corresponds to the lue of the estimated 
percentage. ~Ro\a 1 would be used for estimated per- .tages near 5 or 95 percent, 
row 2 for estimated percentages for 10 or 90 percemi, etc. Then select the 
applicable, cclumn: 

CcLumn A for Directors 
Column B for Instructors 
Column C for Counselors. 

For example, to determine the approximate standard error of an estimated 17 7 
percent found in Table 5.2 one would first identify row 4 as the appropriate 
row. Row 4 is selected because 17.7 percent is closer to the 20 percent of 
row 4 than it is to any of the oiher percentages listed. Column A is selected 
as the appropriate column, sines Table 5.2 is based on project director re- 
sponses. Usin^row 4 and column. A the approximate ^standard error is found 
to be 6^0 :p£xc2ntage poin±s. 
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It should be noted at the outset that no clear picture emerged during 
site visits (or from the questionnaire data) of a "typical" project beyond 
several general procedures and services. The visited projects were charac- 
terized by common purposes and basic activities which serve to define UB in 
a general way. But they were also characterized by notable differences in 
specific program operations, perhaps more different in the academic-year 
component than in the summer portion. There were also distinct differences 
among the 15 visited projects in basic philosophy and thrust, sometimes the 
result of longstanding practice and sometimes related to different require- 
ments in the various USOE regions. Similarly, there were different degrees 
of adherence to the official guidelines governing program operations. It 
became quite cl that all projects do not function in the same way. This 
observation is important in its own right, and also because it means that 
operationally UB does not represent a single intervention treatment. In 
fact, it cannot easily be viewed as two or three clearly defined treatments, 
with respect to either the nature of the actual program or_ the population 
served* 

G rn rie iegislat±ra description of UB purposes ("designed to generate 
skills a d mcrrliration nexressary for success in education beyond high school") 
and the ^uidel:lme's provisions (that the project "must include a cuxxiciilum 
designee:^ m :d£velop positive attitudes tovard learning, creative thinking, 
effective e^ipression" and uhat '"UB is a precollege preparatory program") , 
it shouiix -not have been surprising that actual operations and emphases, as 
well as uinuierlying philosophies, varied somewhat by project. The regula- 
tions xi^nnsmrn?: UB also present a general statement which can be inter- 
preted..: *.z inaa^ programaln.c ways: "projects ...[should] have promise of 
motivati±ng and preparing academic risk students from low^income backgrounds 
and wit. timdequate secondary school prz^sraration to engage successfully^ in 
prograi:>s pc stsecondary and higher edi:::c3.tion. " 

AniOTg trtcr 15 projects visited, various emphases and guiding purposes 
emexgec '^n-r:.:r.r had a direct bearing on actual program operations. For some 
projects tz'^ Ihasic purpose was "to. keep situdents in high school" with a 
concomitant. 'VA^nhasis on basic and remedial learning skills. In others, the 
fundament^sl purpose was nc provide self-confidence and "tutoring as needed." 
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In one isuch project the director stated that it was not possible to teach 
much in the way of academics in six weeks; thus, little attempt was made to 
do so.- Still other projects emphasized, to varying degrees, academic 
survival in postsecondary placements, and thus attempted to implement "no- 
nonsense" programs of academic work and exposure, especially in the summer. 

Indeed, most projects directed their year-round efforts to the develop- 
ment of motivation, awareness, skills, and confidence as related to potential 
postsecondary placements, and in this sense there was considerable common- 
ality. However, for projects with younger students (grades 8-10), it was 
not always feasible to direct the program toward distant postsecondary 
enrollment, and other emphases prevailed. 

Another area of variation involved the kind of postsecondary placement 
emphasized by the projects. Some projects clearly emphasized, and in fact 
virtually required, applications to and placement in 4-year colleges and 
universities. Other projects limited their sights almost exclusively to 2- 
year community colleges (in most instances this was related to the nature 
of the host institution). The majority of visited projects appeared to be 
open to encouraging placemsnt in any sort of postsecondary facility, includ- 
ing technical institutes and short-term practical training. 

Another example of philosophic variation related to the self-direction 
expected of students in the summer program. In six projects, students were 
clearly expected to seek out the help they needed, to look for the tutors, 
to arrange appointments, etc.; there was no organized time or place for 
extra-class assistance. Other projects allowed no room for doubt about 
study and tutoring; they required study hours, required specific tutoring 
and review, and otherwise did not leave this matter up to students. The 
position was held that given the nature of the population and thnir slow 
groping toward maturity, it was necessary to "cover all angles" in order to 
assure a beneficial academic experience. 

There was similar related variation across projects with respect to 
control of the students' time in the summer program, and staff awareness of 
student whereabouts, activities, fulfillment of obligations , class atten- 
dance, and so on. In most instances this variation was related to a philo- 
sophic stance concerning development of student independence and responsi- 
bility. In some projects, summer staff roles included assignment to oversee 
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a group of students directly or indirectly, at all times; but in most 
visited projects, the supervision was less rigorous and reflected an assump- 
tion about student self-management regardless of the ages involved. 

An attempt is made in the remainder of this section to characterize 
some of the common features of the visited projects. In the presentation, 
some of the observed variability in project operation will be specified. 
A documentation of the complete extent of project diversity would, however, 
require a considerably longer discourse than that presented here. 

A. The Academic Year Program 

The academic year program was characterized by weekly or monthly stsff 
contact with students for tutoring or other purposes, and a lonship 
with feeder high schools which Involved a counselor in the school serving 
as "contact counselor*' for the UB students. Among the 15 projects, all but 
two had such contact counselors (although not necessarily one at each 
feeder high school^ whose jx^bs were to stay in touch with students, in 
some cases to arrange for or provide tutoring, and to relay student needs 
to UB staff. 

The academic year program appeared to be a function of the number and 
kind of staff available as well as of project philosophy and purpose. The 
majority of visited projects maintained a skeletal staff (project director, 
secretary, and full- or part-time counselor) during the academic year, 
while others had work-study tutors or part-time instructors in addition to 
the basic staff. Ar the more heavily manned projects, there was an emphasis 
on weekly contact which involved counseling, work with college applications, 
and various sorts of tutoring. In four projects, though, formal evening or 
Saturday classes were held, for which students :pxeregistered and had fairly 
regular responsibilities. One UB project had a very wide range of offerings 
(including two math courses, psychology, vocabulary, local government, 
career choices, history, and English composition) for about 100 students. 
When these weekly offerings (plus counseling, work on college and financial 
aid applications, and tutoring) at one project are contrasted with another 
location where there were four "tutoring weeke^ids" per year, it can be seen 
rha'- UB did not constitute nearly the same sort of assistance or amount 
>jf contact across projects . 
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Formal academic year contact of students with the UB staff varied from 
four times per year to 2-4 hours per week. These contacts occurred on the 
sponsoring campus, at the high schools, or at both high school and campus. 
In one visited project, the contact counselor was in regular touch with 
students at the high school, but UB staff saw them formally only five times 
per year to deal with the postsecondary application process; however, in 
most instances where the contact counselor maintained regular touch with 
students, there was also regular contact with UB staff. Regardless of the 
persons involved, it can be seen that academic year 'onf-- ■ though r^j^uiar 
in most projects, was brief. It may have provided a sense of community for 
atudesjts nr given them a means for getting help when it was needed, but it 
did not always amount to a sustained program of services or activities. 

-In addition to formal and informal tutoring, general counseling, and 
claasfis, visited projects also engaged t:o varying degrees in academic 
counseling, recreation, vocsrional and career advising, and occasional 
cultuxal activities. A few also arranged trips to college campuses for 
concerted exposure to campus life and realities, while for others this was 
reportedly not possible because of lack of funds. With respect to post- 
secondary applications, most projects required that seniors apply to a 
stated nnmber of institutiims (usually three, sometimes two or even five), 
often but not always including the host institution. Understandably, these 
appliiiatioas and all the associated requirements took up a go/' I deal of the 
contact tisie during the acadenic year program, and represented a most 
important element of UB services. 

While projects maintain limited contact with students during the 
academic year, there is a considerable amount of activity behind the scenes. 
During this period, as much effort appears to go into these additional 
processes as into the direct instructional or counseling work with students. 
Based upon visits during the academic year and summer interviews, most 
projects engaged extensively in a variety of important activities which 
included: (1) preparation- of the major UB thrust, the summer program, 
typically involra.ng extensive planning, logistical arrangements, and commun- 
icarion; (2) contact with postsecondary institutions regarding admis£5ions, 
admissions policies, placement, test and other requirements, and financial 
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aid; (3) plans for campus visits and other cultural activities; (4) com- 
munications with feeder high schools concerning designation of contact 
counselor, recruitment strategies, student needs, tutoring plans, possible 
course credits, staff involvement in the summer program, etc.; (5) intake 
procedures with new prospects (applications, parent : nrms, inrervlews, 
medical forms, school recommendations, etc,); (6) nngemen^ for car^- 
speakers or college vi^j-cors; (7) preparation of the project: application 
and associated communications with the host instituticn and the regional 
USOE office; (8) preparation of standard reports; and (9) contacts with 
parents and with advisory groups. 

B. The Summer UE Program 

The characteristic summer experience wds a 6-week oncampus program 
which included formal courses, recreation, cultural activities, tutoring, 
and other opportunities for personal development. At all 15 visited projects 
students lived in the campus dormitories. Most of these projects offered a 
variety of courses (usually one to two hours long) and required registration 
in three or four of them. Often, one of the offerings was "guidance and 
counseling" which typically covered career and academic counseling and, for 
rising seniors, represented the first consistent touch with the postsecondary 
application process. Aside from the typical emphasis on mathematics, 
composition, history, personal communication, literature, and reading skill 
(there was very little opportunity for work in science or foreign language), 
there were usually electives in tne arts, certain sports, drama, and 
creative crafts. 

Some of the visited projects :held these classes, electives, and other 
activities on a regular basis, five days a week, but most projects held 
classes only four days a week, usually reserving the fifth day for tutoring, 
counseling, and special activities (cultural, recreational, or travel). 
The activities were well attended but tutoring was not required or checked 
for some classes. 

Different criteria existed for student selection of formal classes and 
the extent to which students were required to take them. In four projects, 
students were required to take "what they need," .7"hich usually meant math. 
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reading, and/or English. Three projects gave completely free choice to 
students, four steered selection in terms of high school courses the 
following year, one arrnn^ed classes almost exi ively to make up for 
past failures, and .^J. r employed some \t±on . tU^, -3 methods. 

Some projects xli^, / ^11 feeder sea. ois allowed high school 

course credits to UB students zot their UB course work, while others 
reported this was the case with only some high schools. In borh instances, 
credit was usually allowed only for summer work, although certain high 
schools considered only combined summer and academic year work in the same 
subject. About half the visited projects stated that feeder schools did 
not allow such credits. 

With regard to summer program structure and supervision, there was 
also considerable variation among the site-visit projects, amoiriiting to 
three levels of thoroughness as observed. Five of the projects had what 
appeared to be highly programed and supervised summer experiences ^ with 
virtually every minute planned for academic, recreational, and personal 
involvements. All included formal evening study and tutoring up to 9:00 
or 10:00 p.m., and one required that this be done in the program building 
and not in the dorms. Project staff spoke of having learned from experience 
to engage in considerable planning and to involve students at all times, 
under supervision. Another six projects had less structured programs, but 
nonetheless carried on fairly thorough supervision. Students were rela- 
tively free to move about the campus, and especially on the "off day" were 
pretty much on their own. Most of these projects included evening study in 
their schedules. The final set of four projects were rather unstructured 
about both program and supervision (not requiring and/or not checking class 
attendance, for example) and provided little evidence of a carefully 
planned multifaceted exposure of students to the world about them. 

C. Bridge Compquent of Summer Program 

The project i-s directed by the Program Guidelines to provide means for 
further developing skills and motivation, the opportunity to take college- 
level courses, and the possibili;:y of earning college credit. For this 
reason, summer programs include special provisions for those who have 
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graduated from high school and are about to enter postsecondary iustitutions 
(the Bridge Program). For a variety of reasons, there were widely different 
practices among the 15 projects visited. Several projects had no Bridge 
component, including some with otherwise eligible students, and there were 
other cases of special situations. In one case, the project arranged for 
all rising seniors either to go to another institution for further exposure 
to a postsecondary environment or to get a job. 

Though not bearing directly on the nature of Bridge component, it may 
be noted that many eligible students do not participate in the summer 
program at all. A few of these represent UB dropouts, but most are those 
who must work in the summer either for immediate reasons or for purposes of 
fall registration in postsecondary facilities. A few projects encouraged 
some students to work, and one insisted that each student earn and save 
$400 and encouraged them to take concurrently a summer course or two at a 
high school or community college. 

Where college courses with potential for credit were offered, college 
or university staff taught the classes and there was a fairly strong like- 
lihood that attendance was checked and participation was more stringently 
required. A number of such classes were observed. It appeared that most 
students kept up pretty well, though this appeared to be related to the 
amount of tutoring assistance available as well as the instructor's under- 
standing of the group and its needs. Although it was not necessarily the . 
case that students received credit, they had to pass the course • There 
appeared to be as many instances in which the classes were composed exclu- 
sively of UB students as those in which UB students were in classes with 
regular college summer students. Both of these conditions obtained within 
certain projects. 

!)• Other Program Functions 

Most of the functions of the UB projects have been covered in the 
brief characterization given above or will be covered subsequently in this 
chapter. Two relatively important functions were not adequately addressed 
in the questionnaires and can be examined only through the site visit 
findings. These functions, recruitment and selection of students and 
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followup of practices for participants placed in postsecondary institutions, 

will be briefly examined in this subsection. 

!• Recruitment and Selection of Students 

The federal regulations and the DSA Guidelines define the UB 
population as students in the "low family income'' range (as defined 
by the Commissioner of Education) whose achievement in high school is 
such that they are not likely to apply to or be accepted at post- 
secondary institutions. The latter is sometimes labeled as ''academic 
risk for college." Project staff are asked to consider grades, test 
scores, school recommendations, and intuition in selecting students on 
the academic risk criterion. 

Recruitment for the 15 programs visited occurred in anywhere from 
2 to 22 feeder high schools, with recruitment, in essence, accomplished 
by school personnel while selection was the responsibility of the UB 
project director and counselor. There appeared to be only a weak 
positive relationship between number of schools and number of students 
in the program. The Guidelines suggest the importance of recruiting 
from a small number of schools in order to have a sizable cluster at 
each school, but local situations and preferences also entered the 
picture. For example, two projects reported purposeful recruitment of 
small numbers at many schools; and some projects focused on rural 
rather than urban areas, resulting in recruitment from more high, 
schools. On the other hand, the project director and advisory group 
at another project worked to arrange recruitment from only "one school, 
but found that the school system resisted this approach for its own 
reasons. 

So far as could be determined during site visits, all projects 
generally applied the family income guidelines, often relying on 
information that the family was on welfare or lived in public housing. 
In eight projects it appeared that the criteria was explicitly applied 
and 'that this involved considerable checking by project staff. Most, 
but not all, projects asked parents to sign the student's application 
to UB, and this involved signing a general financial statement. In at 
least two projects, parents were required to submit a notarized. 
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statement of income status, and in two others an outside person or 
staff member had to sign a statement verifying total family income. 

On the question of academic risk and presumed ability to handle 
postsecondary situations after UB intervention, it appeared that most 
project directors and counselors relied on school recommendations and 
personal intuition in selecting UB students. (This was no mean task 
in many projects, since there was often a larger number of applicants 
than could be accommodated, especially for the summer program.) There 
Were few absolute criteria reported, though low motivation and low 
grades relative to other students in the local school system were 
often used as a basis for selection. On the other hand, some projects 
looked for clear evidences of high motivation, and others allowed for 
students with high academic performance (but low income) . Staff in 
three projects reported that a fair number of UB prospects had already 
stated their interest in college and had begun or submitted applications 
leaving a considerable question about the definition of "academic 
risk." 

2. Followup of UB College Placements 

There was little evidence of systematic followup of students 
after completing the UB program. Only one visited project reported 
having a comprehensive followup activity, tracking (and assisting 
where possible) students through four years of postsecondary training. 
This project had appropriate records to illustrate its procedure. A 
second project reported carrying out a retrospective followup on 
students who had completed UB within the previous four years. This 
was done through college registrars' offices. 

Most other efforts were minimal -or nonexistent. Seven projects 
indicated that they followed only the students at the host institution 
(and this usually meant only for the first year). Four projects 
apparently had no records or data on followup. The final two visited 
projects were in their first year and had not formulated plans for 
f o 1 lowup ac tivi t ie s . \ 
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^11, PROGRAMMATIC CHARACTERISTICS 



Through an examination of project application forms, UB projects were 
known to offer a wide variety of services to their participants. This 
examination also suggested that different projects concentrated their 
efforts on differing sets of services or activities. This section consider 
staff questionnaire responses concerning the activities that were offered 
by the 54 UB projects and the relative emphasis placed on various UB - 
functions. These results may be viewed as national estimates of project 
level availability and emphasis of specific activities, subject to the 
standard errors presented in Table 5.1. 

A, Program Activities 

Project directors were asked whether certain specified activities and 
services were provided by their project in the 1973 summer and 1973-74 
academic year programs. Table 5.2 displays their responses. In general, 
more projects are seen to have offered various courses, tutoring, coun- 
seling, and other services in the summer session than in the academic year. 
Notable exceptions were activities undertaken to gain postsecondary entry, 
such as classes in preparing for college examinations; information and 
counseling about college requirements, costs, financial aid; and help in 
applying for financial aid. That is, the projects offered more activities 
during the summer program, consistent with the more intensive nature of the 
program during the summer; but projects placed greater emphasis on the 
mechanics of applying to positsecondary institutions during the academic 
year, when such applications are normally processed. These basic results 
are consonant with the impreESslons gained during site visits as reported in 
the previous section. 

The majority of UB projjecrts offered remedial courses in both summer 
and academic year sessions (reading, 98 and 59 percent, respectively; 
remedial English, 83 and 58 percent; remedial mathematics, 88 and 52 
percent). These are courses that would be needed by students performing 
poorly in basic high school subjects. Similarly, large proportions of 
projects offered college. preparatory courses in. the summer (e,g,, non- 
remedial^;£nglish, 87 percent; nonremedial mathematics, 83 percent; social 
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sciences, 68 percent). These courses were also taught in the academic year 
session, but at a smaller proportion of projects (from 37 to 52 percent). 
Among the other courses specified, those in art, special interest, and the 
heritage of minority groups were available at two-thirds or more of the 
projects during the summer, while music and foreign language courses were 
less common (54 and 39 percent, respectively) . In the academic year most 
of these. "elective" courses were available in less than a fourth of the 
projects (with minority heritage offered in 31 percent). 

Among the study skills courses, "how to study" classes were most 
common (51 percent in summer, 38 percent in academic year), followed by 
classes on how to take tests (41 and 33 percent), and classes in preparing 
for college examinations (30 and 38 percent) . 

Considering the tutoring activities^ tutoring by college students was 
nearly universal (98 percent) in the summer, while tutoring by profes- 
sionals was available at nearly all projects during both sessions. By 
examining the four types of tutoring and the three types of counseling 
aggregated within project, it was determined that all responding projects 
with active program operations offered at least one type of tutoring and 
one type of counseling in each session. 

Over 90 percent of the projects offered sports, social gatherings, 

cultural activities, and medical/dental services during the summer, while 

substantial proportions also provided them in the academic year. Even 

though the mandatory requirement for medical services had been removed at 

2/ 

the time of the study,- 91 percent of the projects in the summer and 75 
percent in the academic year offered such services. It is likely that 
these figures include provision of referral services as well as direct 
services. 

In summary, all projects reported some form of counseling and tutoring 
in both sessions; but the availability of remedial, college preparatory, 

27 ' 

- In the program manual for the 1973-74 program year, the former require- 
ment that "academic institutions ... provide necessary health services for 

Upward Bound students " was changed to a suggestion that such services 

"may" be provided (see Application Information and Program Manual . An Office 
of Education Program Administration Manual, 1973-74. WashingtonT D.C. : 
U.S. Department of Health, ' Education, and Welfare, Education Division, 
OE/BHE, p. 37). 
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elective, and study skills courses varied more greatly across projects and 
between sessions. With the exception of study skills classes, these types 
of courses were more likely to be offered in the 1973 summer session but 
dropped in the 1973-74 academic year program, which is in concordance with 
observations at the sample of 15 projects that were visited. 

B. Program Emphases 

Project directors, instructors, and counselors were asked to rank 

order seven functions in terms of the relative emphasis placed on them at 

their projects during the 1973 summer and 1973-74 academic year programs 

(with "1"^ denoting the most emphasized function). Within each project, the 

rank orders assigned to each activity by the project's instructors or 

counselors were averaged so that each activity had a mean rank for each 

3/ 

staff category. For analysis purposes, the ranks of 1 through 3— were 
considered to form one response* category (function was among three most 
emphasized) , while numerically greater ranks formed another response cate- 
gory. For each staff category, two proportions (percent answering that a 
given function was among the three most emphasized, and the percent answer- 
ing it was not) were determined for each function and are presented in 
Table 5.3 through Table 5.5 for project directors, instructors, and 
counselors, respectively.—^ 

It is seen in Tables 5.3 through 5.5 that for both suramer and academic 
year programs, the highest percentages of projects by far (more than 75 
percent), according to each of the three staff groups, placed both tutoring 
or remedial instruction and counseling among the three most emphasized 
functions. For the siimmer session, the third most highly emphasized func- 
tion was cultural enrichment activities, which was p.laced among the three- 
most emphasized functions by 32 percent, 53 percent, and 29 percent of the 
projects, according to project directors, instructors, and counselors, 

37"' 

— More accurately, mean ranks of 1.0 to 3.49, respectively. 
4/ 

— The proportions ranking functions as being among the three most empha- 
sized and as not being among the three most emphasized were used rather 
than other statistics (such as median ranks) because not all respondents 
ranked all seven functions. Thus, the number of cases forming the denomina- 
tor for each function varied with the function. 
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rsv-r-actively. Vyhile tlo^ r^Iatrye jimpcrtance of culturc:-L - nrichment wss tihe 
SHme for che three scaff caitegori^eiSr i-uie responses ^of xnsL-ructors were 
clearly ±Lscrepant from z se of Qooucs-e^lors and projecr directors. In- 
scructors in a project ofteiTi rat^c this function as ..^ong the three 

mist emphasized funcnion^ Clea-riyr xhe same project: ' ailable for all 
sii^ff meimbers to observe rut it i. ]. ossible that p ercsT/^lrm cf project 
ei::::;aa^i~ Is relar^.d tt^. role c± the staff meniber.. Thi . lif f erence cou— i, 
hc'iFtever. be artifactual, ^.nd ref j g~ nothing mcrre than a ffereiitial 
rss^on^jB -set established by the ^^m) cir the factz that a.as::xi:^tors were morre 
ccii3C±snxnious in assigning ranks no tne fiinctions (i.e., iisad the ranks 2 
tiirougn 7 more f reqnuer:itly than directzjrs or counselors) • 

Zor the academic year session^ the function third most emphasized by 
projects was cultural enrichment activities according zo instructors. But 
fax project directors and (aggregated) counselors., the thirrci most empha- 
sized function across projecl:s was liaison work with school and community 
representatives (55 percent of projects according eo ciitlr^'^^'ii'rs and 42 
percent of prajects aiicording to counselors placed this firr-^ion among the 
tirxee mosc eEia'sasized) . 

In smnmary, tutoring or remedial instruction and counseling were 
rnnked by most projects (as reprsented by project direcroxH-, instructors, 
and counselors) as tiie two UB f tnrrctions receiving the mcst: emphasis in the 
projects. Cultural enrichment activities and liaison work with school and 
cGnmunity representi-^es placad a distant third for the summer and academic 
year sessions, respectively. These empirically determined indices of 
program enrphasis were supported by rhe findings daring :3lte visitation. 



Tae cohesiveneeis within the UB projects and the extent to which 
diExinnt subgrouns -zzl project personnel see otbers as supporting tbsizr^role 
ara. matters of dhirsirt ccxKrern for grroject operation- Some informaticn 
regarding the varioras intierrrersonaX relationships listing among suit^onps 
of sta£::f members and stum^Tits with±n the UB projects is the f:ocus or this 
sectior... Some data addr^siag thi^ tnpic were coLLected in the stai^ 



TV. 



INTRAPROJEZT RELATIONSHIPS 
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i ^st±c . ziilxe^.; other Inf onri^rlx^m -^as gained during rhe site visits to 15 

the 54 sampie projects, llindiin^s from both sources will 'be pres.^nted in 
whis se:-:-i!iic7?. . 

Ii::^t:ruct:-rs and counseLcrs asked, in the respective staff ques- 

lionnazrres.. evaluate (on a fiiv -point scale from very unsupportive to 
-ery s-pwrr-^) the extent 1:0 ch project directors supported their 
.rork. r-e r^ponses were aggre:gacsd by project within each of these two 
.^taff ciiinssrrr^es and are presen-^. in Table 5.6. Project director support 
of instr-i— —3: and coucselbrs wc::::^d appear to be quite good, but at the 
prrojec-r l;^cv. - zLt is seen in a sfiightly more favorable light by instructors. 
In 57 perr:aE=: of the projects, ^instructors reported the project director as 
-ery sup-r-arriva, and in 47 persmc of the projects, counselors reported a 
very supTuoxrrz project director N.o projecr had instructors who, at the 
aggregate lev^^, resorted an unsrixpoxtive project director, and in only 
8 percent of the pre n sets did coiaiselors see the project director as 
un s upp o rrive * 

The peri^eiATHd Lower level of support of counselors hy project directors 
could r^iilt frr)m ±hQ. inclusion in the counselor category of the college 
students serving as tutcrr-counselors. The tutor-counselors, also known as 
resident advisors or dorai assist::=nts , served the project chiefly in che 
summer ^ograni. Sin- visits indicated that these college students were to 
atterii jesses (and somerimes t^ach) , tutor students at various times, 
provid- counsel, dir-ct dor.r -nd other activities, and in some cases be on 
24-hcinr call for mDn^corinr '^'^ supervision of students. From their point 
of va.^v, howe\--r, t:::::=DT-'C-::u-^loTs at some x^Lsited pron~e-x:s noted that 
-leir-roleis were not -ile-r . t::^r ^hey felt too much on their own to create 
idisiiT -]mbs^. a-Tid t±iar they tiherrexore felt they were doing less than thiey 
shcml^SHi-rould. llhis ls=rk of -CDmmimication may have resulted in a 
per.C3E.-r/e^ l^Lck oi ssiripor::. In fert, project level communications with 
counslrrrs. in igenens^., nnay hiave been less effective than with instructors. 
It wa^s -zu^ during sits, visits rhat most of the projects did not include 
either rmiiK^alors eir tuTDX-coTinB^rs in their regular staff meetings 
doirimg: zrhsi summer prj^gram. 
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Table 5.6 

SUPPORT OF IN£TE.UCT:SS and C0UN53L0RS BY THE PROJECT DIEECTOiR 









7rcT 


acts ' Ins trustors 


Bro.i 


ects' Counselors 


Degree of PD Support 


-.a, 


WN 




-a/ 


■ WN 








Vexy unsnpportive or 
Unsupportive 




0 


0 


.2 


25 


4 








3 


-■ .9 


27 


5 


S::iiPportive 


37.-3 


123 


22 


3- J. 9 


94 


16 


Vsrr supportive 


56.7 


185 


29 


A 7.0 


143 


24 


^ / 

liide: t ercdLna t e— 


' c 


0 


0 


5.3 


• 16 


2 




lor. , c 


326 


54 


100.0 


304 


51 


f / ' 
Median rating— j 


4,.~ 






4.6 






Mean ratzng^ 


4.. 6 






4.2 






Standard error of 
mean rating 


0 , 3£ 






0.14 






1 .... 



NOTE: Zabl^ ±s bastiisi on responses of irstructors (a^regated by praject) 
::zo PIQ questz^.-^c: 37, azid of counselcrrs (ag^HgsiC3d by projax^t) to 
PCQ question . « Far approximate staaidarri err:ors cf rpercenirfi, 
rexsr to Tab:.- 5 ,1, ciDluinn B for. in^stmictrtrs; coluran C for cotunssLLars . 



Psrcsntages Hre ^^i^d oji 'w¥ ighted rei^^mises, 
Jiirrraers iff'^c .Time 34 sampled projects. 



a/ 

c/ 

— "Tnmbers oi: not :iaclade three projects which., at the time of 
selatnrLan, haai no coDnnselors . Hence the total (urcwexghtad) number rc 
projeirts w±tb. ccmn^^ors was 51* 

d/ 

ThiLS represents primarily item nonresponse (x^e., failure to answer 
an icenu) , fcut also includes multiple responses, our-of -range respxirmses, 
and inconsiHstent responses. 



Weightad numbers and percentages iiray not tota. e:ractl7 diiiie to r^ounding 
error ^ 



en 

— ^ Meau as^^tl median ratrn-gs are baseir on a scali^ 3.f I .00 ('Very rnisupportive' 
to "V£2^ry supportive") . and are coonputed for- detcrrminate respmrses only, 

wi trimrr: adjizstment for iteiirrsionxesponse or indets-^^nnina :e responses ;(Tiiultiple, 
out— of— rsnge^ or inconsistsrrt rasponses.) 
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An item on all three staff quescionnaixes asked staff inembers to 
evaluate on a five point scale (from very poor to very good) the relation- 
ships within and among several groups of tndi-etLduals withia the project. 
Tables 5.7 through 5.9 isresent Che project le^l evaluat:loc-? by .directors, 
instructors, and counselors, respectively, of theses intergroup relation- 
ships. Clearly, whether seen by directors, inistructors. or counselors, 
projects were viewed to have, on the average, good or ver^- good relation-- 
ships wichin and among the categories list^ (students, starf, and project 
director). No projects were -^fiwed by projsc::: directors as hasring any very 
poor or poor relationships, bu^x a small propcmioTi of projects^ as reported 
by instructors and counselor^., ^etze character: -:ed by such rslationships. 
Project directors reported ^f^t relatienshlps of students ^o other students 
were good to very good on tfe average but nirrt as good as other iiLtergroup 
relationships (48 percent jtxdged student: relationships as v^rr good, whereas 
56 percent or more rated otiher relationships this Isval). The instructors 
and counselors (aggregated by project) also v-^ued studert i^arreractions as 
good to very good on the ave^gsu, but did naz s^/stiematicsill:-'- r^ssrd them as 
better or worse than o^ther types. Otther^sa^ dtxzsxertCBiS. ir rhe evaluation 
cy± the various type.s of rslacz.,jas:r^ werre 3z3ie1£., ioth aici between 

t:ables. These resiilts would 3ug?g^ tha-: tm^ proj-^t dirscrriirrs , staff, and 
sxudents formed a highly aohe^sv^'^e ,gr:oup in issst prcjecits.. 

While site visit obsemrerxMns snid interrrTisr^s supporr^d- -ni general, 
the very favorable piature pain -ad hy cn:^-ionnaire r^nnses , exceptions 
were noted. There ras in :facr ^rCTisiderr-iie \-52riablliry ;~ tKc^ levels of 
staff communication aad interair.:-jBn reporre-r — ^rrom excellant ^ entirely 
unsatisfactory. In three projects in partic^jlar:, no mechaniii: was provided 
for communication among instructors, courrseixjrs, and rutar^-ci^nnsfilors (and 
in two cases with senior pnrjec-t: staff), sine thssse persotis rt^'i>rted staff 
communication at a very lasiT l^^^l duria^ fat:>^i:ri^--i^ace Sm^Mz.^w. Tliey also 
reported that students sui&^nsd i-rom Jiack. ox srz^ cohesivTi .---d awareness, 
and that there was a tendsixcr:' fcr project f^-^rjanlon to g DC^r. On the 
othar hand, there was ample indiiiiadriarn ir:.iiiHiry -of the visj^tsid projects that 
communications were regular., laeaningfcl , ancd Tr.:iintaiaed a.- high level. 
In two projects, for example^ the total, srtaf f c^d studert:. be-dy met on 
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Table 5.7 

lETERGROUP RELATIONSHIPS IN THE PROJECT AS EVALUATED BY PROJECT DIRECTORS 



Type of 
Int:er£roup 
Relationship 



Percentage and Ntaniber of Project Directors 
Very Poor- Very- 



Poor 



Fair 



Good 



Good 



Total 



a/ 



Median, y 
Rating^^ 



Students and Other 
Students 



Studeuns and Staff 



SCudeats and pro- 
ject director 



Staff and project 
direaitor 



Staff -and other 
start 



c,c/ 
WN, 

id/ 

^/ 

N- 
.,c/ 

IF-' 

0,0.1 

IF-' 



0.0 

0 
0 

0.0 

0 
0 

0.0 

0 
0 

0.0 

0 
0 

0.0 

0 
0 



17.3 

56 
6 

6.5 
21 
2 

6.9 

22 
2 

0.0 
0 



3. 
12 
2 



34.8 
114 
17 

35.7 

116 
16 

37.1 

121 
18 

38.9 
127 
19 

37.9 

124 
18 



47.9 

156 
25 

57.8 
189 
30 

56.0 
182 
28 

61.1 

199 
29 

58.4 
190 
28 



100.0 
326 
48 

100.0 
326 
48 

100.0 
326 
48 

100.0 
326 
48 

100.0 
326 
48 



4.4 



4.6 



4.6 



4.7 



4.6 



5Jua'ii: Table based on responses to PDQ question 28. For approximate standard errors, 
refer t.o Table 5.1j column A. 

— Weighted numbers and percentages may not total exactly due to rounding error. 

— ^ Median ratings are based on the scale of 1 to 5 for "very poor" to "very 
good," respectively. 

— Percentages are based on weighted responses, adjusted for instrument nonresg^onse 
Nunifaers do not include instrument nonrespondents , 
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occasion; and in two others this entire staff participated in the weekly 
meetings. In addition, tnere appeared to be regular paper. connnunication, 
advance notices of program chsniges and raquirements , aad a general sense 
that all staff menribers ve^-e "am the same team/' A ladk of communication at 
some pro-jects with caninselors and tutor-counselors has previously been 
noted, t ,t during sitH: visit there was also variation in project practices 
concem^-ig summer insrructors. Instructors in seven projects were more or 
less pro-rided with t±e syUabus i^nd materials they were to employ, many 
cirrricuLar decisions having b^en made without consultation. In the other 
eight pxrojects, fonmer srai prospective instructors were purposely involved 
by the staff in developinsg the s:ummer program, and then were quite indepen- 
dent: in directing coinrs^r -icontenir and structure. 

It W3S apparent trrfrrr dnstrixctors were viewed quite differently across 
projects. Instructors ^.-so "beliaved" quite differently with respect to 
personal involvement. :three of the visited projects in particular, they 

Wiiire remiGved (or evem Blofof) from the students and the program except 
duri-ig rmorning clas3 'musznrrs. In other projects, however, instructors par- 
ticipated much more: -e^rs-srLvely by directly tutoring students, accompanying 
then on field trips, zni^i-insliiag , and otherwise functioning as an integral 
part of tihe program... Hhe lavel of commitment was quite obviously related 
to selection of the starff amd to what was outlined and expected by the 
senior project staS, and in some projects complete conmiitment was expected, 
and obtained . 

The overall pz:::t::ira abtatned during the site visits was that most 
piiDjects operated ar a hi^h level of effixiency, coordination, and coimnuni- 
cs±ion; however, a few pn^-ojects appeared to be at the other end of the 
sale, which was not as svideitc in the questionnaire responses* Suffice it 
to note xhat certaim prcqnscts suffered from a combination of operational 
disadvantages (as obsr^/ed and as discussed by interviewees), which hampered 
the staff's feeling rif solidarity and effectiveness. These operational 
aspects (several of ra-nich were apparent in e^ch of these few projects) 
included the followizs^r Ca) unclear role descriptions of instructors and 
tutor-erojunselors, (b) little or virtually no means for staff communication 
and intsiraction in the shammer program, (c) no staff training, no staff 
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meetings, and limited or negligible staff input into the UB courses and 
program, (d) sense of disorganization, lack of planning, unpreparedness to 
handle day-to-day crises or even standard needs, (e) unwillingness of the 
project director to delegate responsibility and make best use of total 
staff talents, (f) unclear purposes, goals, objectives, (g) class attendance 
not enforced, checked, or even expected, and (h) limited coordination of 
courses , schedules , requirements , and activities . 

Even at the most disorganized and uncommunicative visited project, 
however, there was a high degree of camaraderie among the students and a 
particular loyalty to the program and its staff. This generally high 
cohesiveness among students seemed somewhat greater at projects where they 
had been involved in some way in course selection, advisory groups, planning 
for trips, or general program plans. 

V. RELATIONSHIPS WITH OTHER GROUP? AND ORGANIZATIONS 

A considerable portion of project success would seem to be related to 
relationships with institutions, groups, or organizations external to the 
individual project but closely related to project operation. The host 
institution (typically an institution of postsecondary education, PSE) is 
one of the most obvious of these. Certain minimal expectations, in connec- 
tion with the requirements of the official guidelines, are placed on host . 
institutions to evidence their commitment to the UB program (related to 
admitting UB students, providing access to institutional facilities , and 
involvement of college instructors) . 

The project is also quite dependent on other educational institutions 
at both the high school and PSE level. These are the institutions which 
serve, respectively, as the source and ultimate recipients of UB students. 
Projects may also benefit from good relationships with other programs for 
the disadvantaged, notably the other two TRIO programs. 

— The TRIO programs, sponsored by USOE, are UB, Talent Search, and 
Special Services. 
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For their funds and operational guidelines, projects are dependent on 
the national UB program as administered by the USOE regional offices. Pro- 
gram guidelines encourage maintaining good relationships with the community 
that is served by the projects and the use of community sources in program 
operations, in the form of advisory committees. 

This section examines the relationships between the UB programs' and 
these external groups and organizations. Results from staff questionnaires 
and site visit reports will be presented. 

A. Host Institutions 

For the sample of 54 projects there were only two types of host insti- 
tutions, public and private educational institutions. Other . eligible types 
of agencies, such as consortia of educational institutions or other agencies, 
private, nonprofit, or public agencies, were not sampled.—'^ The project 
directors in the sample reported that 90 percent of their host institutions 
were 4-year colleges, while the remainder were 2-year colleges.—'^ 

. Table 5.10 presents directors' reports of whether the agency hosting 
their project administered a variety of other programs for the disadvantaged, 
and if they did, the degree of cooperation between the UB projects and 
these other programs. A small minority (14 percent) of the host institu- 
tions administered Talent Search projects, and nearly half (45 percent) 
administered Special Services projects (the other two components of the 
TRIO program). Larger proportions of the host agencies administered other 
federal and nonfederal programs for the disadvantaged (53 and 65 percent, 
respectively). These statistics should be treated with caution, however. 



6/ 

- According to USOE records, of the 415 projects operating in program 
year 1973-74, 25. projects were sponsored by these other types of agencies 
(see Table 6 of "Program Review. of the Special Programs for the Disad- 
vantaged, Division of Student Support and Special Programs, Office of 
Education," Statement by Leonard H. 0. Spearman, before the Office of 
Management and Budget on August 19, 1974). These consisted of 5 second- 
ary schools, 3 proprietary institutions, 2 public agencies, 7 private 
agencies, and 8 "other." The USOE data do not reveal whether these 25 
projects were part of the universe of projects included in the present 
study (i.e., regular projects in the coterminous United States). If they 
were, none were selected into the study sample. 

— These percentages were based on the answers of 48 respondents 
(unweighted N) to question 14 of the PDQ. 
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because for each of these programs about 20 percent of the projects provided 
no interpre table response. 

Table 5.11 shows the degree of support reportedly received from the 
sponsoring host institution (as well as from a number of other sources). 
No project director rated his sponsoring institution as nonsupportive. 
Nearly half (49 percent) rated their sponsors as very supportive, while a 
slightly smaller proportion (42 percent) rated them as supportive. It 
should be noted that . nearly all other groups listed were also rated, on the 
average, as being somewhere between supportive and very supportive. Only 
the regional and the national USOE offices were rated as being unsupportive 
by any project directors—and this was done by only a small minority (only 
one and six respondents, respectively). These matters will, however, be 
considered in subsequent subsections. 

Closely related to the previous table. Table 5.12 provides project 
directors' reports of whether or not a variety of groups made recommen- 
dations to the projects, and, if so, the quality of these recommendations. 
Only 8 percent of the directors reported that their host institutions had 
made no recommendations. Most project directors reported that recommen- 
dations had been made by sponsors and that they were good (39 percent) or 
excellent (20 percent) . Recommendations were also made by staff and stu- 
dents of all projects, and were the most highly rated of the groups con- 
sidered; 98 percent of the project directors thought staff recommendations 
were ^ood or excellent, while 91 percent judged student recommendations 
similarly. It is seen in this table that only the national office of USOE 

was reported by a sizable proportion (36 percent) of the project directors 

8 / 

not to have mads recommendations.— This probably is related to the project 
directors' perception that the national office was less supportive than 
others, as indicated in Table 5.11. 

In summary, the questionnaire data indicate that the host institutions 
of UB projects were generally regarded by the project directors as being 
supportive of UB and making helpful recommendations to the projects. But 



8/ 

— Due to regionalization of program administration, it is not to be 
expected that the national office would have much direct contact with 
the projects. 
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they were not thought to be as supportive or helpful as UB staff and 
students. On the other hand, the host institutions were perceived to be 
more supportive and making more helpful recommendations than the regional 
or national offices of the USOE, This observed set of findings suggests a 
direct relationship between perceived support and helpfulness of a group 
and the degree to which that group is proximal to the project. 

The site visits provided a unique opportunity to observe relationships 
between projects and host institutions and to document some of the services 
which the hosts provided. The following discussion is based on observations 
and interviews with project staff and representatives of the host institution. 

The USOE expects host institutions to enroll a significant number of 
students from their own UB projects (and from others) . Among the Id visited 
projects, this commitment was met to differing degrees- The percentage of 
UB seniors in tibe piroject admitrsd to host ins titiit ions ranged f rod. a high 
of 50 percent to a .l_3w of less L±Lan 10 percent. Most of the instltzutions 
apparently provided adeqxiate financial aid to admitted UB graduates and 
thiree institutions reported that they gave a full tuition scholarsirip to 
those who were accepl:ed. 

,r 

Most projects had the services of some of the host institutions* own 

regular teaching staff; however, college instructors often represented only 

a small proportion of the UB instructors. Moreover, the majority of project 

directors held faculty or administrative status. It appeared that nearly 

all institutions made campus facilities available to UB students on an 

9/ 

equal basis with regular college students.— 

Vir-tually all visited projects appeared to have at least adequate 
facilities provided for the functioning of the summer program (including 
classroom space, study space, cafeteria, lounge, library, dorms, and meeting 
rooms), although one project^s dorm space was so limited that half of the 
group used it while the other half went home every day. Some projects were 
less fortunate with ^respect to facilities for recreation and other activities 



— In two instances, there were restrictions on the use of the student 
union or the swimming pool (which the institution itself had to rent) ; and 
in one case the institution had no summer session and thus the UB students 
were actually an isolated group housed in very comfortable quarters but 
given no opportunity to see or participate in the life of the university. 
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on a regular basis. Several. institutions did not have such facilities and 
one project appeared to have access only to a small volleyball court. Most 
projects also had adequate office space and it was usually located conven- 
iently near the center of summer academic and social activities. Generally 
speaking, academic year facilities were less satisfactory than those provided 
during the summer. Offices and classrooms were often not so conveniently 
located. In only two cases, however, did these circumstances appear to be 
of considerable concern to project staff. 

Beyond these requirements and suggestions of the program guidelines, 
t^We was o.ther evidence of insititutional commitment observed during the 
site visits. Somie of the notable examples were: (1) a continuous program 
of sisclaL. services for disadsrantaged or minority students so that UB 
appeared to be part of a larger program of services, concern, and action; 

(2) development of special cjo^^lege courses or programs for disadvantaged; 

(3) pro!ris±on of facilities, ei^uipment, buses, etc., without charge; (4) 
covering: ccsts for students to visit or attend summer programs on other 
campuses; (5) contribution of summer staff (instructors, counselors, 
accountant) at no charge or s-aall charge to UB; (6) waivers of fees and 
deposits for UB applicants; (7) reduced fees or no fees for student union 
use, dormitory space, food service, and/or. tuition for Bridge students; (8) 
payment of 75 percent of the project director's salary; (9) full or partial 
financial aid to those accepted; and (10) relaxed admission/retention 
standards for UB students. Most of the above amount to direct or indirect 
financial contributions, and indeed a number of the host institutions 
claimed none or only a part of the 8 percent indirect costs allowable. 

In contrast, it should be noted that several institutions definitely 
did not relax admission/retention standards for UB or similar students, and 
that some institutional representatives pointed out that they could not 
possibly corctinue Upward Bound if federal funds were cut off for any reason. 
While the latter may not indicate lack of commitment, it illustrates the 
dependence on outside funding to carry out such a program, even though many 
of the 15 visited institutions contributed significant proportions of the 
total program budget. 
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It should be noted that the official who directly supervised program 
operation at one of the visited institutions indicated a considerable lack 
of commitment, in that he saw UB as an opportunity to increase funds for 
the college and help to pay faculty salaries. That institution was also 
one of those few deemed to be operating an essen.tially unplanned, uncoor- 
dinated UB program^ and was the only site visited at which real communica- 
tions difficulties between the UB project staff and the host institution 
were revealed. At that project:* the director found that he could not write 
or even authorize checks, since the institution's treasurer had personal 
control of the project's finances. 

It should also be pointed out that a few projects apparently had to 
live with certain restrictions or pressures imposed by the institution that 
affected operations,, staffing, or program. Two projects found, for example, 
that the college lf.brary had to close early each day (with no other provision 
for study space> periodicals^ or reference books). On one campus, UB staff 
could not live in -the dorms with the students, since there was a ruling 
requiring the services of a college housemother. In two additional projects, 
the staff had little or nothing to say in the hiring of summer instructors 
and tutor-counselors, and had to accept those whom the institution provided. 

With the exceptions noted, relationships with host institutions were 
seen as quite good at the large majority of visited projects* supporting 
the results of the questionnaire data. The complete lack of adverse ratings 
of host institutions in the questionnaire responses does, hoxatever, cast 
some doubt on the validity of those responses, in light of the problems 
found to exist at some visited projects. The lack of adversH^^ ratings 
cannon be explained by item nonresponse in this instance, since none existed; 
however, the failure of six project directors to return the questionnaire 
may account for some of the discrepancy. 

B. Other Educational Institutions 

Tables 5.13 and 5.14 display the ratings, by UB instructors and coun- 
selors (aggregated by project), respectively, of the degree of cooperation 
received from high schools and PSE institutions in performing their UB 
functions. Good to excellent cooperation from high schools was reportedly 
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Table 5.13 



COOPERAXlON project received from HIGHI:^SCH00I>S ^ POSTSECONDARY 
INSTITUTIONS: INSTRUCXDR RATINGS 



Perceatage and Number of Projects 



yiper of Inscltutlon 



Poor-Fair 



Good 



Excellent 



c&rr3lnat;e- 



Tocal^^ 



Median , 



Mean . 



S candard 
Error of 
Mean 
Rating 



iigh* Schools 



'OS c secondary 
Cxisclcucions 



WN, 



18.8 

63 

11 

3.1 

10 
2 



46. 7 
162 
25 

60.9 
198 
33 



25.7 

83 

13 

28.5 
lA 



8.9 

29 
5 

7.4 

24 
5 



100.0 
326 
54 

100.0 

326 
54 



3.1 



3-4 



3.1 



0.12 



0.05 



)TE; Table based on responses of instructors, aggregated by project, co PIQ question 39. Hax: approximate standard 
errors of percents, refer to Table 5.1, coluaa B. 

ootnotes follow Table 5 .14 . 

Table 5.14 

COOPERATION PROJECT RECEIVED FROM HIGH SCHOOLS AND POSTSECONDARY 

INSTITUTIONS: COUNSELOR RATINGS * 



Cype of InstltuCion 



iigh Schools 



Post secondary 
Cnstl tut ions 



WN/ 



Poor-Fair 



Good 



Ea^ellent 



Inde^ a/ 
temttnajte— 



Total^/ 



6.9 
21 



14.1 

43 
7 



41.8 
127 
21 

52.3 

159 
27 



43 .3 



293 

91 

15 



7.9 

24 
4 

4.3 

13 
0 



100.0 
304 
51 

100.0 
504 
51 



Median^ 
Batltits^ 



3.5 



3.2 



Mean . 
Rating^^ 



3.4 



3.2 



S tandard 
Error of 
Mean 
Rating 



0.09 



0.09 



)TE: Table based on responses of counselors, aggregated by project, to PCQ question 33. Fox .^3?prox±nate standard 
errors of percents, refer to Table 5.1, column C. 

' This represents prioarily item nonresponse (i.e.,, failura to answer an item)., but also includes multiple responses, 
iit^of-range responses, and inconsistent responses. 

^' Wieighted number? and percentages aay not total exactly clue to rounding error. 

- Mean and median ratings are based on a scale of 1.00 ("poor") to 4.00 (''excellent") ; and are completed for 
eterminate responses only, without weight adjustments for item nonresponse or indeterainate responses (multiple, 
iit-of-range, or inconsistent responses). 

Percentages are based on weighted responses. 

- Numbers do not include three projects which, at the tiae of sample selection, had no counselors. Hence che 
3tal (unweighted) number of projects with counselors was 51. 
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enjoyed by 72 percent of the projects, according to instructors, and 86 
percent of the projects, according to counselors. In the opinion of 
instructors, good to excellent cooperation from PSE institutions was received 
by 89 percent of the projects; 82 percent of the projects, in the opinion 
of counselors, had such cooperation. 

The cooperation of high schools and PSE institutions is usually very ' 
important to the success of UB projects. Projects typically depend on high 
schools for help in recruiting participants, in providing complementary 
programs of study for students, etc. Projects also typically are aided by 
postsecondary institutions in processing UB participants' applications, 
granting admission and administering financial aid, and sometimes in provid- 
ing for the needs of UB students in those institutions. Thus the high 
degree of cooperation reported by instructors and counselors is impressive. 
However, precisely because of the importance of the schools* cooperation to 
the success of UB, it is expected that a high degree of cooperation would 
hava bveen developed .-^^ 

The high degree of cooperation from PSE institutions reported in the 
questionnaires was also indicated during site visits. Since the projects 
do not share sites with any PSE institution other than the host, it was not 
possible to confirm this reported cooperation excep t in the case of the 
host institution (see previous subsection). In general, the directors (and 
to a lesser extent counselors) interviewed, during site visits reported 
close and fruitful personal contacts with admission officers and financial 
aid officers at several PSE institutions. Those relationships had apparently 
been fostered over a period of years. 

Information obtained during site visits indicated that all visited 
projects enjoyed at least adequate relationships with high schools, and 
five projects appeared to have excellent communications, with the schools. 
In addition to a general sense of cooperation (provision of transcripts, 
teacher and counselor recommendations, time for conferences with staff and 
students), most feeder high schools provided the services of a contact 
counselor who devoted anywhere from 3 to 10 hours per week to UB activities 



— Cooperation was probably developed both by hard work and by the stra- 
tegic selection of the schools with which to cultivate relationships. 
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(in most cases without reimbursement from the project) • Moreover, feeder 
high schools for eight of the visited projects gave time and space for UB 
staff to recruit and interview students in the fall, and five projects 
reported that time and space were regularly provided in the schools for UB 
staff to tutor students during the academic year. Overall, there was a 
strong sense of cooperation and open communications, although this varied 
to some extent from school to school. 

C. Other Programs 

Some indication of the nature of relationshps with other programs is 
presented in Table 5,10. That table shows the project director's reports 
of cooperation with other programs administered by the host institution. 
Although the results were attenuated by a relatively large amount of inde- 
terminate response, the overall thrust of the reported data is that cooper- 
ation with these other programs is at least good for the preponderance of 
cases where they exist. Only two of the 36 responding project directors 
reported low levels of cooperation with other projt^cts administered by the 
host institution, one each for a companion special services program and a 
nonfederal program for the disadvantaged. Table 5.15 presents project 
directors' reports of other special programs for disadvantaged youth (in- 
cluding, those operated by the host institution) operating in the same 
geographic area and, if there were such programs, of UB cooperation with 
them. For each of the other programs listed^ the vast majority of UB 
directors knew whether or not such programs operated in their vicinity. 
For two programs. Cooperative Vocational Education and Work-Dropout Preven- 
tion, a sizable percentage of directors were not knowledgeable (41 and 29 
percent , respectively) , 

According to the project directors' reports, 48 percent of the UB 
projects did not have other UB projects operating in their area, while a 
similar proportion did. Talent Search and Special Services projects were 
usually present in the same area as the UB projects. A large majority of 
the UB directors reported cooperative relationships with these projects. 
With the exception of 'the Job Corps, which did not function near 42 percent 
of the projects, the remaining programs listed in Table 5.15 often existed 
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Table 5.15 



PROJECT DIRECTORS' REPORTS OF OPERATION OF AND COOPERATION VITH 
OTHER PROGRAMS IN THE SAME AREA 



I 








i 


in Area J and: 




I 


Type of Other 






Program 




Does not 


Inde- . 
terminate — 


Total-' 


Programs 




11 III /ll6& 


Not in Area 


Cooperates 


Cooperate 


OCher Upward Bound 


!£/ 




1 










Programs 


2.4 


47.6 


46.8 


0.0 


3.2 


100.0 




lid/ 


8 
1 


155 
21 


152 
24 


0 
0 


10 
2 


326 
48 


Talent Search 




4.5 


28.6 


59.3 


2.3 


5.2 


100.0 




WN 

Ni/ 


15 
2 


93 
16 


193 
26 


8 
1 


17 
3 


326 , 
48 


Special Services 




4.2 


21.8 


66.4 


1 Q 
J. . 7 




100.0 




WN 
Sd/ 


14 


71 


216 


6 


19 


326 




2 


12 


29 


1 


4 


48 


Neighborhood Youth 
















Corps 


4.2 


1.5 






J. b 


100.0 




WN 

si/ 


14 
2 


5 
1 


281 
41 


15 

o 


12 
2 


326 
48 


Job Corps 




4.2 


42.4 


39.2 


J . □ 


O . 0 


,100. 0 




UN 

id/ 


14 


138 


128 


18 


28 


326 




2 


19 


20 


3 


4 


48 


Cooperative Vocational 
















Educational Prograo 


40.6 


12.9 


34,3 


0.7 


J. 2 


100.0 


1 




132 
18 


42 
6 


112 
18 


29 
4 


11 
2 


326 
48 


Hiffh School ttorlc— 
















Study Program 


17.5 


13.5 


42,0 




7 7 


100.0 




WN, 
lid/ 


57 


44 


137 


63 


25 


326 




9 


6 


21 


8 


4 


48 


Work - Dropout 
















Prevention Program 


28.8 


24.7 - 


31.0 


8.7 


6.8 


100.0 




WN 


94 


80 


101 


28 


22 


326 




14 


12 


14 


4 


4 


48 


High School Equivalency 


jc/ 














Prograc 


10.3 


6.2 


71.4 


8,6 


3.6 


100.0 




WN, 
Nd/ 


33 


20 


233 


28 


12 


326 




6 


3 


33 


4 


2 


48 


Veterans' Programs 




12.3 


17.6 


50.7 


17.5 


1.7 


100.0 






40 


57 


166 


57 


6 


326 






• 7 


9 


21 


10 


1 


48 



KOTE: Table based on responses to PDQ question 31. For approximate standard errors of percents, refer to 
Table 5.1» column A. 

a/ 

— This represents primarily it em nonre-g;>cnse (I.e., failure to answer an item), but also includes multiple 
responses* out-of~range responses. inconsistent responses. 

— ^ Weighted numbers and percentages nay not total exactly due to rounding error, 
c/ 

— Percentages are based on weighted responses, adjusted for instrument nonresponse , 
d/ 

— Numbers do not include instrument nonrespondents . 
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in the same geographic area as the UB projects. In general, if the other 
programs operated in the vicinity of UB projects, cooperation existed. 
Presumably, the UB projects benefited from this type of cooperation, as well 
as the other programs. 

This cooperativeness reported in the questionnaire results was also 
reported during site visits. Some of the specific incidents of cooperation 
mentioned were: (1) cross referrals of clients; (2) followup and assistance 
to UB college placements ((Special Services program. only) ; and (3) pooling 
of resources to esta b lish Lgood community relationships. 

P. USOE Regional Office 

Some indications of relationships with USOE regional offices has 
previously been presented in Tables 5.11 and 5.12. Oiay 6 percent of the ' 
directors reported that no recommendations had been made by the regional 
offices, and of those directors who reported having received recommendations, 
the large majority reported that the recommendations were good to excellent. 
The regional offices were reported as supportive or very supportive by 87 
percent of the directors, as "indifferent" by 11 percent of the directors, 
and as unsupportive or very unsupportive by 2 percent of the directors. 

The nature of project relationships with the USOE regional offices - 
were also investigated during site visitations. It should he pointed out, 
however, that site visit data is particularly weak in this area due to the 
fact that no more than two projects were visited in each region and infor- 
mation about the relationship was obtained primarily from the project 
director. Nevertheless, some insight into these relationships can be 
gained from the site visits. 

The valence of the reported relationship with the USOE regional offices 
was generally positive, but there was considerable variability. Project 
directors as a group reported varying degrees of communication with regional 
offices. Projects in tinree regions, for example, noted satisfaction in the 
dispatch with which C8r±:ain decisions were made. Directors in another 
region reported that there was regular arid adequate communication, including 
a yearly site visit, a proposal conference, feedback, and a meeting of the 
region^s project directors. The general sense among projects in the six 
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other regions, however, was that there was less than optimal communication. 
The regional staff responded when asked for assistance, but generally had 
no systematic program of visiting, monitoring, evaluating, or assisting UB 
projects. It was also noted that there was little in the way of training 
for project directors. 

Perhaps the most common concern, across projects and across regions, 
was the timing of notification of funding and consequent actual late funding. 
Several UB personnel noted that these circumstances hamper program develop- 
ment, the hiring of the best instructors and counselors, the implementation 
of staff training, student travel and other activities, . and that they cause 
a considerable lowering of staff morale. In two regions it was found that 
students were already on campus in the summer program before notification 
was received of the approval of the grant. While these situations reflect 
more upon the riskiness of the project director (and to some extent on the 
willingness of the host institution to back him up), apparently some verbal 
statement of funding had been obtained but written confirmation of the 
grant had not been received. In all fairness to the regional offices, it 
should be pointed out that they are but the last link in the chain involving 
funding and, thus, are constrained from making their funding decisions 
until other sequential decisions regarding guidelines and available funds 
have been made within another branch or agency of the federal government. 

There were more specific concerris bearing on program management and 
operations. Staff in several projects felt that regional requirements were 
often precipitous or counterproductive. For example, a sudden decision at 
the regional level purportedly required one project to change summer plans 
at the last moment and to recruit a whole new contingent of older students. 
Other expressed concerns included: (1) being required to drop students who 
had been within poverty guidelines at induction but had crept above it a 
year later; (2) having to meet a certain staff-student ratio requirement at 
the last moment, making it necessary to release four instructors; (3) 
rejecting a project's operational definition of "academic risk" without 
providing any other definition or guidance. 

Many of the complaints leveled at the regional offices were possibly 
misdirected. Project directors seemed to see the regional offices as 
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• having more latitude in administering the program than they had in reality. 
Since the nature of these complaints rarely bear on matters over which the 
regional offices have control, they will not be documented; however, the 
misperception on the part of project directors as to the nature of regional 
office operations does signal a communications or rapport problem. 

Community and Advisory Groups 

Projects are encouraged by the federal regulations and guidelines to 
utilize community resources in operating UB, in the form of advisory com- 
mittees. The guidelines further suggest three community-based committee 
types (Community Resources, Parents, and Academic), and the composition is 
outlined as consisting of parents, low-income community leaders, and repre- 
sentatives of colleges and high schools. Additionally, a student advisory 
committee is suggested, to be composed of UB participants. 

Table 5.16 shows project directors' reports of having Community 
Resources^, Parent, Academic, or Student Advisory Commit cees. As seen in 
txie table, 95 percent of the project directors reported the existence of a 
Parent Advisory Committee, while 82, 70, and 50 percent reported Academic, 
Student Advisory, and Community Resources Committees, respectively.—^ 
The table also shows that in nearly all projects with the specified commit- 
tees, the committees reportedly met at least twice a year, with most meeting 
at least four times a year. 

The impression of advisory committees gained during site visits was 
somewhat different. \s^±le all but two visited projects had advisory commit- 
tees, most of these had just one such group. The single committee was 
typically composed of all the community members suggested in the guidelines 
plus UB students. In one case, however, the committee was composed entirely 
of parents. It may be that while actually one committee exists at these 
projects, subcommittees handle the issues related to community relations, 
academic matters, student concerns, and parent concerns. Such subcommittees 
may have been afforded full committee status for purposes of questionnaire 
completion. 



— These percentages exclude projects that either failed to answer these 
items or reported not having the committees. 
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Tables presented earlier (Table 5.11 and 5.12) showed the project 
directors* evaluation of the support received from community groups. As 
shown in Table 5.12, project directors rated recommendations received from 
community groups as good, on the average—not at the level of recommendations 
from other groupis closer to projects (such as students or staff), but 
better than those of the USOE regional and national offices. The entries 
in Table 5.11 indicate that the local community was considered by project 
directors to be supportive, but slightly less supportive than nearly all. 
other groups considered. Thus, it seems that while project directors 
reported that the interactions of their projects with the community were 
satisfactory, they were not as good as relationships with groups more 
closely related to the projects. This is consistent with reports received 
during site visits. ^ , 

Table 5.17 lists a number of services that parents or community groups 
may perform for the UB projects. While the services included in the list 
may be rendered by any parent or community group, they are ones that the 
various UB Advisory or Resources Committees are likely to perform.—^ As 
indicated in the table, all but one of the services on the list were reported 
to have been performed for at least 74 percent of the projects. The excep- 
tion was the service of "securing additional funds," which was reported 
performed at only 43 percent of the projects.—^ Also presented in Table 
5.17 are the project directors' ratings of the effectiveness with which the 
services were performed. On the average, the performance of most services 
were regarded as moderately effective or slightly better. "Offering 
suggestions for program improvements" was seen to have been done very 
effectively, but securing additional funds (the one service performed for 
less than half of the projects), was seen to have been ineffectively executed, 
even when performed. One would not expect parent and community groups to 
be very effective in securing additional funds. 



12/ 

— The question (number 25 of the PDQ) inquired whether parents or com- 
munity groups had performed the services, neither excluding nor explicitly 
including the Committees. 

13/ 

These percentages exclude projects not responding to these functions 
and those reporting they were not performed. 
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Site visit observations indicated that the advisory groups generally 
functioned in one of two ways. Either they provided some guidance and 
assistance on routine or emergency matters, or they served public relations 
functions and aided in raising scholarship money. They were viewed — and 
viewed themselves— as advisory in nature and not as policy groups, although 
in two projects advisory members interviewed prospective instructors. 
Advisory groups at visited projects met anj-where from once to four times a 
year. There was relatively little indication from project staff of tha 
essentiality of these groups, but they wer^ generally viewed as important 
to UB for reasons of moral support, communications, and contact with parents, 
At one project, all school superintendents in the target area were on the 
project's advisory board. One result of this was exemplary relationships 
with feeder high schools, and another was the willingness to release 
school counselors for annual one-day workshops to discuss and study Upward 
Bound. 



VI. COST ANALYSIS 



USOE is the primary source of financial resources for the UB program, 
so it is important that the program be described and analyzed in terms of 
its financial characteristics and the relationship of those characteristics 
to other program resources, processes, and outputs. The variability of the 
distribution of sources and uses of funding will be described, and inferences 
concerning differences in program economy is expressed. 

The primary data source for the cost and staffing pattern analyses was 
the set of fiscal and staffing questions contained in the PDQ. Attempts 
were made to obtain other sources o£ data regarding costs. One "such source 
sought was the Quarterly Financial Report for Upward Bound Projects (OE 
Form 1227), containing data on the total federal and nonfederal funds 
approved and expended during the fiscal year for personnel, nonpersonnel, 
and indirect cost categories. Another financial report, the Annual Financial 
Audit Report for the 1974 Fiscal Year, was also requested from the projects. 
This latter report contains beginning and ending balance sheets of project 
assets and liabilities, and a statement of revenues or receipts, expenditures, 
and changes in fund balances for the fiscal year. 
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The use of these supplemental data sources wa.^ precluded due to insuf-- 
ficient return of the requested reports. The Quarterly Financial Report 
for UB (OE Form 1227) was requested from all sample projects but received 
from only 21. With this I-fjaiued return rate, the information on OE Form 
1227 was of potential use only as a consistency check for the PDQ. Unfor- 
tunately, comparable data from the PDQ and OE Form 1227 were available for 
only 16 projects. The total funding reported on the ?BQ for those projects 
was $124,322, or 8 percent more than the $114,602 reported on OE Form 1227. 
The sample of 16 comparable projects was too small to derive reliable 
inferences about the consistency of responses between the two instruments; 
in fact, differences in the level of funding reported in the questionnaire 
and OE Form 1227 might be expected for several reasons. Requests for the 
Audit Report for the 1974 Fiscal Year met with even less success, and the 
11 forms provided did not permit the use of this information. 

The PDQ responses were thus the only remaining source of fiscal infor- 
mation with a sufficient number of responding projects; however, a con- 
siderable potential for trvror exists in these data. The PDQ solicited an 
extensive complex of fiscal and staffing information, leading in some cases 
to complete or partial omissions or misinterpretations of specific details. 
The nature of the responses in many questionnaires reflected the difficulties 
experienced by project directors in allocating costs among the various 
categories for the summer and academic year programs. 

Responses to the questionnaire item concerning the sources and uses of 
funds were further confounded by alternative treatments of in-kind contri- 
butions. In some cases, project directors separated in-kind contributions 
from their estimates of the sources and uses of fundr-; in other cases, in*- 
kind contributions were included at their estimated cash value. This 
created a problem when it could not be determined which approach was taken. 
A related problem occurred when the question regarding contributions and 



Site visit verification of these responses during interviews with 
project directors indicated that all directors questioned (12) had omitted 
relevant items or had misinterpreted the exact nature of the required 
fiscal or staff data. Although 15 sites were visited, on three of these 
visits the responses co^ld not be verified since the PDQ had not been com- 
pleted prior to the visit. 
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in-kicd payments was not answered. In such cases, the absence of response 
was assumed to mean that no cash or in-kind contributions were received (an 
assumotion that may or may not be warranted) . 

Responses to the PDQ were edited and were verified (and revised if 
necessary) during site visits to insure maximum validity for the analysis. 
The extent of uncovered discrepances within and among data sources suggests, 
however, that instances of double counting, omission, misinterpretation, 
and response errors very likely remain in the data which were not verified, 
and the results of the analyses must be interpreted cautiously. 

Although questionnaires were mailed to a sample of 54 projects selected 
from UB projects funded in program year 1973-74, the number of projects for 
which data were available for analyses of project costs and staffing patterns 
ranged from 16 to 48, depending upon the type of association under 
review. Due to these large variations in item and subitemi^^ response 
rates, some difficulties wer?, encountered in analysis. Fcr this reason, 
two types of population estimates for aggregate cost characteristics are 
presented in this section: (a) unweighted estimates that were computed 
using unit weights without adjustments for instrument nonresponse; and (b) 
weighted estimates that were computed using the unequal sampling weights 
after imputation for missing data.i^^ Xhe unweighted estimates are quite • 
possibly biased due to the combined influence of unequal probabilities of 
sample selection, unrepresentativeness of nonrespondents , and response 
discrepancies. The weighted estimates are also subject to response error 
biases and also include error introduced due to the imperfect relationship 
in Che regression equation used to impute missing values. Thus, while the 
unweighted estimates have fewer possible sources for bias, they contain an 



Only 48 projects responded to the PDQ. 
16/ ^ 

In many instances, project directors would provide total cost fie-ares 
but not component costs, or provide total year costs without providing 
separate breakdowns for the academic year program and the summer program 
17/ 

~ Imputations for missing cost data were determined by using the best 
fitting linear regression equation between project costs and project size 
(I.e., number of students served). Sampling weights used were inversely 
proportional to the probability of project selection. 
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additional source of possible error. The extent of improvement or deteri- 
oration in accuracy of the weighted estimates is, therefore, unknoxm. The 
weighted costs (computed for major cost categories-^average total project 
costs and average cost per student for the sunuuer^ academic year, snd total 
year program) are presented primarily to provide alternate estimates for 
comparison. 

Unweighted estimates alone are presented for the detailed cost com- 
ponents (e.g.» personnel, travel, equipment) within the major cost categories 
due to the high nonresponse rate for some of these components. The relative 
level of the detailed cost components to the total cost categories was the 
issue of analysis, and the ratios were believed to be stable between the 
weighted and unweighted cost data; therefore, calculations using weighted 
data are not reported. For the regression analyses, reported in subsections 
B and C, unweighted data were used throughout. 

A. Descriptive Profiles of Project Costs 

The cost data from the PDQ were analyzed to obtain a descriptive 
profile of the UB projects with respect to sources and uses of funds for 
the 1973 summer program, the 1973-74 academic year -program, and the total 
program year. This profile, illustrating the levels of cost in each cate- 
gory, is contained in Table 5.18 and was derived from data submitted by 35 
to 39 UB projects, depending upon the particular category of cost and 
funding source. Since fewer projects contributed to the estimates of the 
cost components than to the totals, the stmi of the component entries in the 
columns of Table 5.18 will not equal the total project cost figure given in 
the table. Totals of the components within a given program session (ac- 
ademic year or summer) will, however, repre:3enc the sixm of the elements 
leading to that total. 

The unweighted average total cost per project (excluding in-kind 
contributions) was estimated as $122,206 for the 1973-74 program year. The 
unweighted total project dollar costs averaged $69,532 for the 1973 summer 
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Table 5.13 

AVERAGE COSTS OF UPWAHD 30tWD PHOJECrTS, BT SOCKCES OF KTJOS 





_ . 1973 Sunsoer Froeram-^^ 


1973-74 

Acadeciic Year Procr-rn?--' 


Average 
Total, 
Cosc^' 


Cose Cacegorles 


$ From 

Federal 

Sources 


$ Froxi 
Nonfederal 
Soxirccs 


. .Tota-^'^ _ 


$ Frod 

Federal 

Sources 


$ Froja 
*ioTxxcderai 
Sources 




Personnel coses: 
Salaries and wa^e^ 
Fringe benefits 
Conaultajita and coatracc 
services 


$26,360 
2,032 

175 


$2,677 

uo 

55 


$29,037 
2,142 

230 


$26,S>3 
2,446 

275 


$4,604 
345 

25 


$31,597 
2,791 

300 


$60,634 
4,933 

530 


Travel 5 
Scudeac 
Ocher 
Total 


1,722 
2,343 


Ul 
170 


1,833 
oSO 
2,513 


1,9a 

817 
2,715 


126 
100 
226 


2,047 
917 
2,9U 


3,880 
1,597 
5,454 




819 


130 


949 


365 


92 


457 


1,406 


Ho on and Board 


17,523 


866 


13,389 


8,551^^ 


0 


8,551 


26,940 


Stipends 


4,195 


U7 


4,312 


9,521 


161 


9,682 


13,994 


Tuition 


1,325 


595 


1,920 


156 


0 


156 


2,076 


Other direct cost^ 


4,704 


22S 


4,932 


4,020 


453 


4,473 


9,405 


Indirect coses 


2,430 


867 


3,297 


2,661 


1,587 


4,248 


7,545 


Unweighted total 
jaroiect costs^' 


63,773 


5,615 


69.532 


51,524 


6,873 


56,226 


122.206 


Weighted total/ 
oroiect costs^ 






63,769 






51.863 


111,986 



KOTE: 



The average cost values presented in this table are based oa data froo 35 to 39 project responses, 
depending on the cost category considered* the cooponenc cost figures result from unweighted calcu- 
lations with no adjustments for instmaent ot item nontesponse. If sotae cocjpoflent cost inroraation 
were given within a program phase (summer or acadea;ic year), then omitted items were assumed to be 
SO. CO wiehin chat phase- 

a/ 

— Based on the diita from 37 to 39 projects. 

b/ 

— Sased oa the data from 35 to 38 projects, 
c/ « 

- tor the composicc costs, this represents the simple sum cf the total average costs for the cvo program 
components. This is not tha case for the weighted emd unweighted total program costs (see footnotes e and f) . 
d/ 

- Jith the exception of total figures, this represents the simple sum of federal and nonfederal figures. 

^ Due to smaller numbers of projects providing component Information than total cost iaformaticn, sums of 
average component costs within columns do not equal average project ccst for that column. The totals within 
this row will not equal the sum of the averages for the separate program phases or funding sources since the 
averages are based on data from different subsets of project^s. 

f/ ' 

Computed using sampling weights and imputatioas for missicg values. The total within this row will 
not equal the su-^ of che averages for the separate program phases since the averages are based on imputed, 
values computed from different regression equations. 

2/ 

This expenditure for rocm and board during the academic year (which is not a residential program) is 
somewhat surprising. Certain expenses might be expected (such as lodging and meals during visits to other 
institutions or cultural activities at sites of some distance from the project, or rent for some campus 
facilities used). T:-,e entry may, however, reflect error due to the difficulty reported (and observed) of 
project directors in completing the questionnaire items related to projec;: expenditures. 
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program and $56,226 for the 1973-74 academic year program.—^ When missing 

values vere imputed and sampling weights were applied, the average yearly 

cost per project was $111,986, and the average costs for the 1973 summer 

program and the 1973-74 academic year program were $63,769 and $51,863, 
19/ 

respectively. — The weighted costs are seen to be approximately 8 percent 
less than the corresponding unweighted costs. 

The actual dollar amounts for the compusite costs are probably in^ 
flated. The average total cost is less than the sum of the composite costs 
within every column of Table 5.18; this suggests that projects with smaller 
operating budgets did not report total costs. Moreover, the weighted 
average total costs (which give greater weight to the smaller projects, 
that were less likely to be selected into the sample and that have smaller 
budgets) are less than the unweighted average total costs. If one accepts 
the weighted figures as more accurate, then this also suggests inflated 
values of the composite cost averages. The major concern regarding com^ 
posite costs, however, lies not with their absolute value but with their 
value relative to total costs. This matter will be addressed below undcc 
the assumptions that: (1) proportional allocation of resources is, on the 
average, relatively stable over projects; and (2) the larger projects, 
which contribute most heavily to the reported composite cost figures, are 
in fact representative of the population in their allocation of funds. For 
these computations the sum of the composite costs was used in determination 
of proportional costs rather than using the Average Total Cost. 

For the summer program, personnel costs accounted for $31,409, or 45 
percent of the sum of all component costs; nonpersonnel direct costs 
accounted for $35,528, or 50 percent of the sum; and indirect costs accounted 
for $3,297, or 5 percent of the sum. In comparison, the unweighted costs 



18 / 

— Total unweighted program year average cost is not equal to the sum 
of the average costs for the summer program and the academic year program, 
since computations leading to these values were based on different subsets 
of projects. Summer costs were based on data from 39 projects, academic 
year costs were based on data from 35 projects, and total year costs were 
based on data from 35 projects reporting both summer and academic year 
costs . 

19/ 

— The weighted program year average cost is not equal to the sum of the 
average costs of the two separate program phases. This is because three 
different regression equations were used in imputing missing values (one 
each for the summer program, academic year program, and program year) • 
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for the 1973-74 academic year program were distribute^ as follows: per- 
sonnel costs were $34,688, or 51 percent of the sum; nonpersonnel direct 
costs were $29,224, or 43 percent of the sua; and indirect $4,248, or 5 
percent of the sum. For both programs, wages and salaries constituted the 
largest single expense, followed by payments for room .and board and stipends, 

The data on average costs of UB projects contained in Table 5.18 
suggest that the average total costs for the 1973--74 academic year program 
were comparable to the costs of the 1973 summer program in magnitude. 
While the summer program is of shorter duration, it is more intense, in- 
volving more full-time staff members and often more students. There are 
also additional expenses incurred during the summer program involving the 
housing and feeding of UB participants on the host institution campus.— ^ 
The allocation of costs within the two program sessions differs somewhat, 
primarily in the intuitive increase during the summer program of expenses 
for room and board for the residential students and for tuition (presumably 
for summer Bridge students who are taking college credit courses). 

As can be seen from Table 5.18, nonfederal funds account, on the 
average, for a small proportion of project costs. During thfe 1973 summer 
program nonfederal funds made up only 8 percent of the sum of federal and 
nonfederal expenses. During the 1973-74 academic year program, the analo- 
gous percent was 11 percent. The average nonfederal values are, however, 
somewhat misleading. More than half of the responding projects reported no 
nonfederal funds, while the maximum nonfederal support reported was $175 
thousand and $100 thousand for the summer and academic year programs, 
respectively. 

The estimated project cjsts described above are dollar costs to the 
projects and exclude the value of in-kind contributions; i.e., resources 
contributed to the projects, such as office space, facilities, equipment, 
and administrative, service delivery, and support services, provided free 
or at a price below value. Unweighted estimates of the value of in-kind 
contributions, obtained from responses to the PDQ, were $4,084 per project 



20/. 

- Although some expenses for room and board were reported for the 
academic year, these expenses are greater for the summer program (see 
Table 5.18). 
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for the summer program and $5,065 per project for the academic year program 
The average composition of in-kind contributions by source is shown in 
Table 5.19. Although the magnitude of the bias is unknown, the estimates 
of in-kind contributions are believed to be biased downward due to concep- 
tual difficulties of estimating the extent and value of such contributions, 
and because they were omitted or not valued on many of the questionnaires 
(and assumed, in these cases, to be zero). However, unless gross bias 
exists, the value of in-kind contributions is relatively insignificant 
since the reported values of these contributions constitutes only about 8 
percent of the total unweighted average value of funding. 

B. Project Cost Differences 

Project costs for the 1973 summer program and the 1973-74 academic 
year program varied widely among the UB projects. The unweighted average 
total costs per project for the summer program, excluding in-kind contribu- 
tions, was $69,532, but individual project costs ranged from $9,792 to 
$175,000; and the average total cost per project for the academic year was 
$56,226, but varied from $17,500 to $134,000. To infer from the above data 
that one type of program was more or less costly than another would be 
misleading since many factors must be accounted for. Factors which were 
analyzed for association with the variations in project costs included 
whether the project was for the summer or academic year, the number of 
students served by the project, the area or density of the population 
served by the project, the type of host institution, and project staffing 
pattern. Project costs were analyzed with respect to these factors to 

determine the magnitude and direction of their influence. Linear regres- 
. 21/ 

sion analysis — ^ x^as the primary statistical method employed to measure the 
degree of association between total project costs and the factors listed 
above. 



— This method generates the equatior; for a straight line that provides 
the "best" prediction of some criterion variable from a predictor variable 
(or set of predictor2variables) . The square of the correlation between 
the two variables (R ) measures the proportion of variance in the criterion 
variable that may be accounted for by this linear prediction. See 
Appendix I for a more detailed discussion of regression analysis. 
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Table 5.19 

AVERAGE CONTRIBUTIOS OF SPONSORING AGENCIES OR 
INSTITUTIONS TO UPWARD BOUND PROJECTS, 1973-74 





1973 
Summer Program 


1973-74 
Academic Year 


Total 1973-74 , 
(Sum of Columns)— 


Source of Contributions 








Cash 


? 788 


$ 881 


$ 2,155 


In-kind 








Personnel 


1.038 


2,071 


3,059 


Facilities 


2,068 


2,458 


4,295 


Other 

Total Contribution^'^ 


978 


536 


2,949 


5,216 


6,410 


12,361 



NOTE: 

* — wuu'^w ww^^j^^^ ^-wiufuucu ua aata rrom to 4J 

projects. The average values are unweight^-d and based only on 
determinate responses. 

a/ 

Values are not equal to the sum of values in columns 1 and 2 because some 
projects furnished data only for the total program year and thus do not contri- 
bute to the summer or academic year averages. 

Total values are not equal to the sum of the components because some 
projects provided only data for total contribution and thus do not contribute 
to the componeac averages. 
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1. Project Size 

In these analyses, a logical causal relationship was inferred 
(e.g., the total project cost depends upon the number of clients 
served). Once the linear regression line is determined, one may 
predict the total project cost based on the value of the causal 
variable, and a comparison of this, predicted number with the actual 
data provides useful information on the degree to which a project's 
cost varies from the norm. 

Unweighted project costs were analyzed separately for the 1973 
summer program and the 1973-74 academic year program as well as for 
the aggregate total annual project costs. Before project costs were - 
analyzed, the data were adjusted to account for differences in the 
number of students served in the summer program and the number served 
during the academic year. For analysis purposes a weighted average 
number of students served was obtained from the following calculation: 



Weighted Average^ 



(Number of \ /Number of studentsV 

students in ^{ academic year 

summer program/ \program 



T 11, 



A regression analysis of the association between the total yearly 
cost per project and the average number of students per month in each 
project confirmed the intuitive conclusion that project costs are 
positively associated with the number of students served. The equation 
derived from the regression analysis is: 

TOTAL ANNUAL PROJECT COST = $1,722 + $1,499 (^Xn^s'tS " ' 

A statistic derived from the regression equation, the squared correlation 
2 

coefficient (R ), indicates that the association is relatively strong; 
specifically, that 58 percent of the variation in total costs among 
projects may be explained by the variation in the number of students 
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served by the projects. The regression equation was based on cost 
data from 34 projects.—'^ 

A scatter diagram, the "best fit" line from the regression equa- v 
tion, and the 95 percent confidence ir^terval for predicted values of 
total cost are shown in Figure 5.1. Each point represents, for a 
single project, the coordinate of the number of students (on the 
horizontal axis) and the total project costs (on the vertical axis). 
From the regression line one could predict that the total cost of a 
project which served 100 students per month would be $151,622, i.e., 
$1,722 + $1,499 (100). . ' ' ' 

^ An analysis of project costs, classified according to summer 
program costs and academic year costs, yielded a somewhat different 
perspective of the relationship between project costs and the number 
of students served. The regression equation for the total project 
costs allocated to the summer program as a function of the total 
number of students served in the summer program was: 

PM^CT^?<5 = $13,261 + $657 fjOTAL NUMBER OF STUDENTSN 
PROJECT COSTS ^IN THE SUMMER PROGRAM / 

This relationship accounted for 46 percent of the variation in the 
total summer program costs among projects -and was based on cost data 
from 38 projects. 

A comparable equation for the relationship between the total 
academic year program costs and the number of students in each aca- 
demic year program was also determined. Approximately 49 percent of 



22/ _ . ~ 

Statistical significance of the regression equations derived will not 
be presented. Recall that the regression analyses were performed with un- 
weighted data which assumes equal likelihood of the data points (which 
was notexactly the case for the current project sample). Moreover, pro- 
jects with nonresponse to the PDQ or to the cost item could not contribute 
to the analyses. It is likely that the responding projects were not renre- 
sentative of the total population for this reason' ^Finally, t^e sampling 
pian used was not simple random sampling and a design effect may have been 
introduced (some calculations performed in analyzing other data for this chapter 

ecuSv 1 r/^' f"'"" ^1°^^ ^° 1' however). Assuming 

equally likely data points, no bias due to nonresponse, and a design effect 

shln'wh.vJ^^'^^f u^"^^ — r''^''''"^'^ °" relationships. No relation- ' 
^i™^^ occurred more than 1 time in 100 by chance under these • 

assumptions is reported in this chapter. 

ERIC 



the variation in total project academic year costs was explained by 
project size* The equation derived from the academic year data was: 



TOTAL ACADEMIC _ / TOTAL NUMBER OF STUDENTS IN \ 

YEAR COSTS ^^^^ ^ \^THE ACADEMIC YEAR PROGRAM ) 

and was based on 34 observations. The regression lines, associated 

data points, and 95 percent confidence intervals for the summer program 

and the academic year program are shown in Figures 5.2 and 5,3, 

respectively, 

2. Other Factors 

• Ev6:i7. though the average number of students served per month 
appeared to be a good predictor of project costs for the entire pro- 
gram year, factors other than project slz^n certainly influence the 
level of project fundings and, consequently, project costs. Other 
factors which were examined for their influence on total project costs 
were the type of host institution and the relative proximity of the 
project to its students. Thirty-five of the 48 respondents to the 
PDQ, whose projects were sponsored by either a public or private 
educational institution, furnished comparable cost data. Table 5.20 
summarizes the average yearly total project costs according to the 
classification of sponsoring institutions for those 35 projects. The 
difference in total costs between types of sponsoring institutions is 
quite small in light of the small sample size and the large standard 
deviations of the costs. 

Another factor considered was whether project costs varied with 
respect to the geographic location of the majority of its students. 
Project divrectors were asked to indicate the percent of their project's 
students who came from each of 10 location categories. Their responses 
were then collapsed into three general location categories (based on 
the location of the majority of its students) as follows: (a) rural 
or small town, including reservation, rural or farming community, 
small city or town of fewer than 50,000 people that is not a suburb; 
(b) medium-sized city or suburb , including medium-sized city (50,000- 
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100,000 people), suburb of a medium-sized city, suburb of a large 
city, suburb oi: a very large city; and (c) city with over 100^000 
people . 

A summary of the unweighted average total project costs for the 
three categories of project location is given in Table 5*21. The 
average total costs for projects with a majority of their students 
from medium-sized cities or suburbs and those for projects with a 
majority of their studcdnts from large cities are quite similar at 
$148,296 and $137,985, respectively. In comparison, the average total 
cost of those projects with a majority of their students from small 
towns or rural areas was $100, 891— approximately $40,000 less than 
projects in the other two categories. Noting that projects in small 
towns and rural communities tend to. serve fewer students than those in 
larger communities, it is quite possible that project size is contri- 
buting to these observed differences. (When project size is controlled, 
no such locational differences are observed — see subsection IV. C 
below.) Further, since the range of project costs within each location 
category was relatively large and the differences in total project 
costs among location categories were relatively small compared to this 
variability and the small sample sizes, there is little indication 
that location of students is an important factor in affecting project 
costs. 

Total project costs for the 1973 summer and 1973-74 academic year 
programs were also reviewed with respect to staffing characteristics, 
classification of the host iu^citution by academic level, and propor- 
tion of project .-osts funded by USOii. No associations were found. 
3 . Summa ry 

The primary conclusion from the analysis of project: total costs 
is that project si2e is the greatest identifiable determinant of 
project total costs, and that other variables examined show little 
or no meaningful relationship to costs after partialling out the 
effect of project size. Project size is, however, a reliable pre-- 
dictor of total project costs, explaining approximately half of the. 
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total variation in costs among projects (for summer program, academic 
/'jar program, and total program year). No other variable examined 
except staff size showed a meaningful association with project costs 
(since staff size and number of students served are very closely 
related, these results are not reported). In the next subsection the 
impact of different factors on project costs will bo reconsidered, 
after adjusting the data to remove the influence of project size. 

C. ^Project Costs Per Student 

A positive association between the level of project costs and the 
number of students participating in a project was expected, since a project 
receiving extensive financial resources is capable of serving more students. 
Conversely, a project proposing to serve many students is likely to receive 
more funding than a email project if for no other reason than to provide 
for student stipends and the larger staff required.—^ In the preceding 
subsection, a strong positive association was shown to vexist between the 
total project costs and the number of students served by a project. Other 
factors of interest are more effectively examined after the cost data have 
been adjusted to account for the influence attributable to project size. 
This adjustment was made for the annual total project cost data by dividing 
the costs by the weighted average number of students served each month, 
yielding a cost per student measure. Adjustments were made for the 1973 
summer program and the 1973-74 academic year program cost data by dividing 
the total project costs attributable to those programs by the total number 
of students served in each of those programs. These data then provided the 
basis for further analysis. 

As part of the cost analysis, the project cost per student was analyzed 
with respect to project size, staffing patterns, type of host institution, 
and the type or size of the community in which the majority of the project's 
students are located. However, no meaningful associations were found to 
exist between project ^osts per student and any of those project character- 
istics. For example, the relationship between the level of total yearly 

Proposed number of students to be served is the major determinant in 
the funding equations used by the USOE Regional Offices. 
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project costs per student and the weighted average of the number of students 
per month sarved by each project was examined to determine whether economies 
of scale existed among UB piojects. Such economies would be demonstrated 
if the project costs per student were inversely related to the number of 
students in each project. Mathematical transformations of the data (natural 
logarithm) , as well as the raw data, were analyzed by linear regression 
analysis to determine the degree of association which existed. None of the 
resulting equations were found to explain more than 10 percent of the total 
variation in total costs per student among projects. 

The unweighted total cost per student served in the summer program 
averaged $853 with a standard deviation of $234* This was comparable to 
the total cost per student incurred in the academic year program, which 
averaged $711 with a standard deviation of $248. Corresponding weighted 
estimates were $830 per student in the summer program and $700 per student 
during the academic year. Thus, the program costs per student were nearly 
identical for weighted and unweighted costs, and the differences existing 
between program phases was small relative to the standard deviations, 
considering the small sample size. 

VII. PROJECT STAFFING PATTERNS 

A characteristic of UB projects which may impact on their capacity 
and capability to. provide, services to students is the project staffing 
pattern. A descriptive profile is presented in Table 5.22. 

During ^he 1973*-74 academic year prograa the project staff averaged 
3.4 full-time and 9.3 part-time employees, and the 1973 summer program 
consisted of 10.2 full-time and 13.0 part-time persons-. The average 
values are misleading, however, because a few projects maintained very 
large staffs, while most contained relatively small staffs. This does not 
mean that small projects operated with skeleton staffs, but that the mix of 
employees, by type of position, varied among projects and that individuals 
performed multipl<i funct:.ons in projects. It should be noted that the 
average number of full-Liime proji^^ct directors per project was less than one 
(mean = .8), since the directors of some projects allocated a porf'on of 
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Table 5.22 



DESCRIPTIVE PROFILE OF UPWARD BOUND PROJECT STAFFING PATTERNS 
BY SUMMER AND ACADEMIC YEAR PROGRAMS 





Average Number of 


Persons Employed 


In: 


1973 Summer Program 


1973-74 Academic 


Year Program 


Type of Position 


Full-time 


Part-time 


Full-time 


Part-time 


Project Director 


.8 


1 

. X 


• 8 




.1 


iisaxsi.a.nu rroject 


.6 


1 

. X 


c 

.J 




.1 


3JXI. ai^^oj. 










U/^JU V CJt 9 J. U Y 


6 


X . o 


. 0 




.7 














1.8 


3„3 


.2 




2.4 


TtI Qi" T"im t"r^T• 












Senior Counselor 


.5 


.5 


.3 




.2 


Tutor/ Counselor 


3.4 


3.4 


.4 




1.9 


TuCor 


.4 


.7 


.0 




1.5 


Secretary 


.8 


.2 


.7 




.2 


Volunteers 


.1 


.7 - 


.2 




.7 


Other 


1.2 


2.4 


.3 




1.5 


TotaX 


10.2 


13.0 


3.4 




9.3 



NOTE: These results axe based on responses from 48 project directors to 

question 39 of the PDQ. The reported values result from unweighted 
calculations with no adjustment for instrument nonresponse. 
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their time to other programs or activities, and were not conunitted full- 
time to UB. 

To describe the profile of staffing patterns more generally, the 10 
staff positions were collapsed into three staff functions: (a) Adminis- 
trative , including project director and assistant project director; (b) 
Service Delivery , including university instructor, high school instructor, 
senior counselor, tutor /counselor , and tutor; and (c) Support , including 
secretary, volunteer, and other. A sunnnary of the average number of persons 
employed for each staff function is contained in Table 5.23. From this 
summary a single measure of project staffing intensity was generated. This 
measure, the number of full-time equivalent (FTE) employees, was calculated 
for each project by adding one-half the number of part-time employees to 
the number of full-time employees.—^ As Table 5.23 illustrates, the 
number of full-time equivalent employees is similar for the summer and 
academic year program for administrative and support personnel, but differs 
significantly for service delivery personnel, due to the intensity of the 
siunmer program services. An average of 11.5 FTE persons are employed 
daring the summer program but only 4-3 FTE persons are employed, on the 
average, during the academic year program. 

A question of interest about staffing patterns was whether the propor- 
tion of project funds expended for personnel costs was related to the 
number of students served by a project. To answer this question a regres- 
sion analysis was performed with the proportion of total costs allocated 
for personnel as the dependent variable, and the average number of students 
served per month as the independent variable. As one might expect, the 
proportion of a project's total costs allocated to personnel expenses is 
inversely related to project size. The regression equation derived was: 

TOTAL PERSONNEL COST ^ /AVERAGE NUMBER OF N 

TOTAL PROJECT COST * ^^^^ " -^^^"^ ^STUDENTS PER MONTH^ ' 



— While the calculation used to determine FT£ employees is reasonably 
valid for the siaimner program, it may provide an artifically inflated 
value for the academic year program. During the academic year, it is 
not uncommon for part-time staff members to be employed for less than 
8 hours per week (typically an evening during the week or Saturday 
morning) . 
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An economic interpretation of the relationship is that during the 1973-74 
program year, a maximum of 66 percent of project expenses were for personnel; 
but the proportional allocation declined by 2.4 percent for every 10 students 
added to the project. This interpretation is intuitively reasonable since 
each functioning project would require a basic complement of administrative 
personnel regardless of its size. The equation, however, explains only 35 
percent of the total variation in the proportion of total project costs 
allocated to personnel expenses ;imong projects, leaving 65 percent of the 
variation unexplained. 

VIII. SUMMARY 

This chapter has desci^oed a large number of dimensions of the 
structure and function of UB projects, using as units of analysis the 
project as represented by the responses of project directors, instructors, 
and counselors (responses of ins true ;:ors and counselors having been aggre- 
gated separately within project). Also presented in this chapter were the 
large bulk of observations made during site visitations to 15 projects. 
After a general characterization of UB operations, as drawn from site visits, 
major topics addressed in the chapter were: programmatic characteristics 
of the projects, including activities offered and project emphases; inter- 
personal r'3dlationships of individuals within the project; project relations 
with other groups, institutions, and organizations; project costs; and 
project staffing patterns. A table of generalized standard errors was 
provided to aid in interpretation of tabular results. 

A major finding of both site visits and quesfionnaire results was that 
Upward Bound does not appear to represent a single intervention treatment, 
or even two or three clearly delineated treatments. While most program 
purposes appeared to be common among the sample of projects visited, and 
among those returning staff questionnaires, there were many important 
differences in the implementation of UB, and thus it was not easy to describe 
even a ''typical'* project except in the most general terms. 

Site visits revealed considerable insight into project operations. 
Projects differed in their purposes, emphases, and assumptions. While most 
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projects encouraged students to aspire to and prepare for pqstsecondary 
education of various sorts, certain projects emphasized personal/social 
development or completion of high school even to the extent of deemphasizing 
academic attainment and postsecondary placement. Similarly, some projects 
left it up to the students' maturity and independence to follow through on 
academic and other responsibilities in the summer program, while other UB 
projects managed and supervised the student's every waking moment. It \s 
also found that projects differed with respesct to the rationale for selecting 
or requiring the summer courses students would undertake — as well as the 
nature and extent of tutoring, counseling, and classwork during the academic- 
year component. The net result of these variations in purpose and content 
was that some projects seemed to have somewhat limited programs with respect 
to the disadvantaged and their academic futures, while other projects 
appeared to be highly organized and highly confident of their purposes and 
impacts. 

All visited projects engaged in active recruitment of UB prospects, 
usually with the considerable assistance of contact counselors at feeder 
' high schools. There appeared to be little difficulty or disparity in 
applying the low-income guidelines in the selection of UB candidates, but 
in interpretatJ^jn of "academic risks/* difficulties of definition were 
encountered and various procedures were subsequently employed. Project 
staff relied on grades, grade averages, aptitude test scores, teacher or 
counselor recommendations, evidences of student motivation (or lack of 
motivation), and personal intuition in selecting UB students. 

Once students were formally enrolled, they had considerably different 
programs organized for them, depending upon the particular project. Within 
the academic-year component (regardlo,3s of number of years involved in the 
program) , the students might find their program to consist of irregular 
contact comprised mostly of c-mseling, or find a series of weekly meetings 
involving counseling, tutoring, and formalized classes. They might b- in 
touch with only the permanent project staff— or might also have contact, 
with counselors, tutors, instructors, or special lecturers and career 
educators. They might spend considerable time in applying for college 
admission and financial aid, or they wight have only a tangential touch 
with that process. 
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Summer programs were much more likely to fit a common mold: 3ix weeks 
of formal classes, recreation, tutoring, cultural activities, and exposure 
to the vjider world of the host institution. At the same time, there were 
important differences: some projects offered course options to students 
while others did not; some programs appeared to be considerably more struc- 
tured than others; In some cases, students took weekend trips to other 
campuses or had other planned experiences away frcm the campus, but else- 
where this opportunity was not provided; and the student might or might not 
have a college instructor as a teacher. Perhaps the most important varia- 
tion had to do with the Bridge component, the special arrangement made for 
those who had just been graduated from high school. Several projects did 
not have such a Bridge program, and thus a fair proportion of otherwise 
eligible students did not have either college courses, contact with college 
instructors, or the possibility of earning college credit. 

In both summer and academic year sessions, counseling and tutoring 
were offered by all projects, but the availability of remedial, college 
tireparatory , elective, and study skills courses varied more widely across 
projects and between sessions. Except for study skills, the courses were 
more likely to be offered in the 1973 summer session and dropped in the 
following academic /ear program. Corresponding to the universal availability 
of tutoring and counseling acrv js projects and sessions, tator:'.r>.g or remedial 
instruction and counseling were seen by all three staff groups as being by 
far the most emphasized functions in their project during both the .1973 
summer and 1973-74 academic year programs. Cultural enrichment was generally 
perceived by the staff as the third most emphasized function in the summer 
session, while liaison work with school and community representatives 
replaced it as the third most emphasized function in the academic year 
session. 

Relationships within and between project staff members and students 
appeared to be generally very good, as reported in questionnaires and as 
observed during site visits. The questionnaire results did appear to paint 
a more favorable picture than was supported by site visit ob-: ^rvations. 
While face-to-face interviews conducted during site visits did reveal £,ome 
few projects in which intraproject communication and cooperation were 
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strongly criticized, such negative evaluations were noticably lacking in 
the questionnaire reports. At every project visited, however, there seemed 
to be a high degree of camaraderie among students and a particular loyalty 
by the students to the project and its? staff, as mirrored in the question- 
naire reports. 

The relationships of the project to external groups and organizations 
were also examined. One of the most important external agencies was the 
postsecondary institution hosting the project. There appeared to be many 
evidences of a considerable commitment by the host institutions to. the UB 
concept and Che particular project. For example, most institutions gave 
faculty or administrative status to project directors, many included their 
regular instructors in the summer program, and virtually all provided the 
program and facilities of the institution on an equal basis for both UB 
students and regular students on that campus. In addition, ther« were many 
indications of financial support of the project to a greater or lesser 
degree,, and in most cases the institution supported other programs of 
assistance to minority disadvantaged youth along vv^ith the Upward Bound 
project. 

By and large, projects reported maintaining good to excellent rela- 
tionships with the feeder high schools. In particular, many high schools 
allowed credit for makeup or advanced work, provided the services of a 
"contact counselor" as a liaison with UB, and encouraged UB staff to recruit 
in the schools. The projects also reported good to excellent relationships 
with postsecondary ins tut ions , other than the host institution. 

Communications with the USOE regional office were generally less 
satisfactory than that with host institutions or high schools. In particu- 
lar, many projects reported during site visits the need for more assistance, 
monitoring, feedback, and direction than they were receiving, and some 
project staff noted that a number'of important decisions appeared to be 
made unilaterally at the regional office level. 

The majority of host institutions also administered other programs 
for the disadvantaged, and, in general, the project directors reported 
cooperation with these programs. Additionally, project directors reported 
cooperation with other programs for disadvantaged youth which operated in 
the area. 
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Relationships with the community, through the various UB project 
advisory committees, or otherwise, were reported to be good. Individuals 
and groups in the community were reported to offer good suggestions to many 
of the projects, and the general level ot support of these groups in 
performing a variety of UB functions was rated to be good. 

Cost and staffing pattern profiles were developed and an examination 
of the degree of association existing between those factors and other UB 
project characteristics was conductor. The analysis of the sources and 
uses of funds provided a descript: . .'ile of the financial character- 

istics of UB projects. Thei weighted ^ ^age total cost per project (ex- 
cluding in-kiiid contributions) was $111,986 for the 1973-74 program year. 
For the 1973 summer program, the weighted average project cost was found 
to be $63,769 or $830 per student served; for the 1973-74 academic year 
program average cost was $51,863 or $700 per student served. Federal sources 
contributed well over 90 percent of the funding necessary to support the UB 
projects. Additionally, an average of $9,149 worth of in-^kind contributions 
such as office space, facilities, eviuipment, and personnel services, were 
received by the projects. There was considerable variability of the cost 
figures, particularly in the area of nonfederal support, which ranged from 
values of $0 to well over $100 thousand, with the preponderance of projects 
reporting no nonfederal funding. 

Project costs wete examined with respect to the nxjmber of stuuents 
served, the location of tlie majority of students served, and personnel 
staffing patterns. The only one of those factors found to be meaningfully 
associated with total project costs was the number of students served by a 
project. About half of the variation of total costs among projects could 
be explained by the variation in the number of students served by the 
projects. This proportion of explained variance was relatively constant, 
whether cor'sidering rne total prc;^r2ia year, the academic year program, or 
the sxiUimer program. 

To analyze any additional impact of other factors > the cost data were 
adjusted to account for the influence attributable to the number of students 
in projects. The adjusted cost data, representing cost per student, were 
^.hen analyzed with respect to the other factors. No meaningful associi^tions 
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were found to exist between the adjusted cost data and any other project 
characteristics considered. 

Project staffing patterns were described and analyzed to determine 
whether a degree of association existed between project staffing patterns 
and other project characteristics. On the average, projects carried about 
1.5 FTE administrative employees and approximately 3 FTE support employees 
throughout the year but the number of FTE employees delivering UB services 
varied from 4.3 during rhe academic year to 11.5 during the summer programs. 
There was, however, considerable variation about the average project staff in 
profile. No associations were found exxst between project staffing 
patterns and other project characteristics. 
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Perceptions of the Upward Bound Program 
by Participating Students 

I . GENERAL 

This chapter presents UB students' reports of thei^ activities in UB, 
their perceptions of the usefulness of these activities, their reports of 
the benefits they have derived from participating in UB, and their evalu- 
ation of var.lous aspects of the program. For several reasons, these data 
are potentially quite valuable. The UB participants are uniquely able to 
provide a necessary perspective of the p ogram— the perspective of the 
persons for whom the program was planned and executed. Furthermore, the 
participants can directly testify to the benefits they have gained from the 
UB program, as well as to the disappointments they have experienced. 

The UB program as described in previous chapters has primarily ref Ifc-o'. ed 
the perceptions of the persons who executed the program, and who would be 
expected to have different points of view and tnsights other the.' those of 
the participants. The UB student perceptions of the program, presented in 
this chapter, are based on reports of those who completed the BSQ. This 
subgroup of the UB student sample is not representative of the total UB 
sample and also not completely representative of UB students eligible for 
the BSQ (see Chapter 3, section VI). Those UB studehts in the original 
sample who had dropped out of UB by the spring of 1974 did not fill out the 
BSQ. BSQ data were also not available for those who remained in the program 
but who, for whatever reasons, were absent from the various questionnaire 
administrations. Thus the responding group Is self -selected , representiiig 
students who had continued to participate in UB and who were willing to 
complete the questionnaire. Although the UB students being described in 
this section do not represent the entire population of UB participants, 
their perceptions of the UB program are presented because only the BSQ 
respondents were asked detailed questions about the nature of their UB 
participation and their opinions of various aspects of the progiam. LI 
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To facilitat'i presentation of results, the population of UB students 
to which the results of this section generalize will be referred to as ''UB 
students." It should be kept in raind, however, that this population is not 
the entire UB participant population as defined by the sample. Rather the 
population being described is a subset of the entire UB participant popula- 
tion, and consists only of those UB participants who would have completed 
the BSQ. Though not directly testable, it seems likely that the BSQ respon- 
dents, as a group, may perceive the UB program in a more favorable light 
than the. nonresponding or ineligible groups. 

The format of the tables presented in this chapter differs from that 
of the tables in previous chapters, .which v/ere based on UB staff question- 
naires. Because of the relatively snail numbers of staff respondents, the 
staff tables presented both the weighted and unweighted niimbers of cases 
for each cell of each table, so that the reader would be able to judge the 
credibility of the results based on the number of respondents involved. 
The number of UB respondents to the BSQ is sufficiently large, however, to 
allov presentation of only the total numbers of respondents and total 
sampling weights. Any cell containing fewer than 20 respondents will be 
identified by an asterisk. The generalized standard errors to be used for 
the percentages reported in thia chapter and an example of how to use them 
are given in Table 6.ic 

II. EXTENT OF PROGRAM PARTICIPATION 

The extent of the UB students* participation in the program is seen as 
an aid in interpreting their perception of the program. For^ this reason 
appropriate items were included in the BSQ, and responses to these items 
will be presented in this section. 

T^"'^le 6.2 presents the percentage distribution, by grade in school, of 

ttie TB cv.'Mdents in terms of the number of summer and academic year UB 

_ ... 

— me inagnitude of the sampling error of perrents is dependent on the 
number of respondents to an item (the denominator of a percent) as well 
as the number in a cell (the numerator). Because of unequal weighting 
and nonresponse adjustments, a few res indents could represent a great 
many... Thus, when a cell contains only a few respondents, t n statistic 
based on it warrants greater care in interpretation. 
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APPEOyiMATE STANDARD ESUORS OF ESTIMATED PERCENTAGES FOR CHAPTER 6 



Row 


Estimated 
Percentage 


j 


Estimated Standard Error 
(in percentage points) 




A 


B 


C 


D 


1 


5 or 95 


0. 5 


0.8 


? 1 


1 A 
X . t 


2 


10 or 90 


0.7 


1.1 


1.6 




3 


15 or 85 


0. 9 

• 


1.3 


1.9 




4 


20 or 80 


1.0 


1.5 


2.1 


2.6 


5 


25 or 75 


1.1 


1.6 


2.3 


2.8 


6 


30 or 70 


1.1 


1.7 


2.4 


3.0 


7 


35 or 65 


1.2 


1.8 


2.5 


3.1 


8 


40 or 60 


1.2 


1.9 


2.6 


3.2 


9 


45 or 55 


1.2 


1.9 


2.6 


3.3 


10 


50 


1.2 


1.9 


2.6 


3.3 



NOTE: This table contains estimates of approximate standard errors appli-^ 
cable to the majority of estimated percentages contained in Chapter 6. The 
table was constructed to provide a general order of magnitude of the stan-- 
dard errors of estimated percentages, and is based on the results of a 
number of different standard error calculations. The formulas and proce- 
dures used in these calculations are detailed in Appendix B. 

To use the table to determine the approximate standard error for an 
estimated percentage, first identify the appropriate row and column to use. 
Select the row that most nearly corresponds to the value of the estimated 
percentage. Row 1 would be used for estimated percentages near 5 or 95 
percent, row 2 for estimated percentages near 10 or 90 percent, etc. Then 
select the applicable column: 



Column A - For Tables 6.3, 6.6, 6.7, and 6.9. 

Column B ~ For Table 6.8. 

Column C - For Table 6.4. 

Column D - For Table 6.2 and 6.5. 



For example, to determine the approximate standard error of an estimated 
2.5 percent found In Table 6.3, one would first identify row 1 as the 
appropriate row. Row 1 is selected because 2.5 percent is closer to the 
5 percent of row 1 than to any of trhe other percentages listed in the table. 
Column A is selected as the appropriate column, because the estimarec per- 
centage was from Table 6.3. Using row 1 and column A, cae approximate, 
standard error is found to be 0.5 percentage points. 
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Table 5.2 



NUMBER OF UPWARD BOUND SESSIONS IN WHICH STUDENTS 
HAD PARTICIPATED, BY HS GRADE LEVEL 







a/ 

Number of Sessions— 


Grade Level—'' 


Academic 
Summer and ""Jaar 


10th 


11th 


12th 










0 1 

0 2 or more 

1 0 
I . 1 

1 2 or more 

2 0 to 1 
2 2 

2 3 or more 
3 or more any 
ind eterminat e— 

Total Percent— 


11.3 
0.8* 
7.4 

36.1 
-.5* 
0.2A 
1.6* 
0.8* 
0.2* 

37.0 
100.0 


12.4 
0.9* 
7.3 

36.6 
6.4 
1.1* 
4.7 
0.9* 
1.2* 

28.5 
100.0 


5.3 

1.3* 

3.9 

20.8 

12.9 
3.6 

17.1 
5.3 
6.8 

23.0 
100.0 


Total N (weighted) 

e/ 

Total N (unweighted)— 


2815 
413 


7551 
1093 


8394 
1193 







NOTE; Table ba.sed on responses to BSQ question 52. An asterisk (*) indi- 
cates less than 20 cases (unweighted) . For approximate standard 
errors, refer to Table 6.1, column D. 



— Because students were asked hew inany sessions they had "taken part 
in," all students should have responded with at least 1 academic year 
session, since the BSQ was administered in spring 1974. Some students 
may have interpreted the question as requiring the number of sessions 
coiupleted, since some answered "0" academic year sessions. 

Of all the students surveyed, 32 (238 weighted) could not be classified 
as to their grade level. Percentages are based on weighted responses, 
adjusted for instrument npnresponse. 

c/ 

— This represents primarily item nonresponse (i.e», failure to answer 
an It.'im), but also includes multiple responses, out-of-range responses, 
and inconsistent responses. 

Percentages may not total to 100 due to rounding error. 

e/ 

~ These ni^bers do not include instrument nonresDor^dents . 
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sessions they had attended through spring 1974. As seen in the table, che 
■ rate of indeterminate response was unusually high.-'' The high nonresponse 
rate obscures the meaning of the results, since the nonresponding group was 
probably selective, -ti general, hotrever, the results indicate that che 
students in the higher grades reported having participated in more sessions, 
but the increase in extent of participation with grade level was not as 
great as might be expected. This result may be partly caused by memory 
error and nonresponse bias, but it may also reflect an underrepre^entation 
among twelfth graders of those who had participated in UB for an extended 
time, since, as reported in site visits, such students tended to drop out 
of UB during thair senior year in order to work. 

The results presented in Chapter 3, Table 3.9 shed additional lij.ht on 
thia matter. From that '„able it can be seen thac the median length o;; tune 
of UB participation among the UB students responding to the BSQ was less 
than one year at the time they completed the questionnaires. Thus the 
perceptions presented in this chapter are based on the responses of a group 
in which at least half of the students had less than one year's experience 
as members of a UB project. 

III. FIRST SOURCE OF INFOPJ'ATION ABOUT' UB 

The source from which UB students first hear about the program has 
relevance for program recruiting. A r -tion of the BSQ asked students to 
identify the source of this first inf ion about the program. 

The UB students reported first hearing of UB from a variety of sources, 
as seen in Table 6.3. The source most frequently cited (by 30 percent) was 
other UB students, followed closely by school guidance counselors (24 
percent). UB staff members (11 percent) and school teachers (7 percent) 
were less frequently cited, although they might be intuitively expected to 
be logical first sources of information aoout UB. 

These results are consistent with information about the recruiting 
function of the projects obtained during site visits. Some student 

2? ~ " 

- The students were required to answer both the number of summer and 
academic year sessions for the response to be determinate. 
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Table 6.3 

STUDENTS' FIRST SOURCE OF INFORblATION ABOUT UPW^VRD BOUND 



rii-sr oource 


a/ 

Percentage— 


An Upward Bound student 


29. 


7 


Other students 


7- 


3 


vUpward Bound staff member 


11. 




School teacher 


6. 


9 


School guidance counselor 






Principal or assistant principal 


1. 


2 


1. , ptxcoL, Oi raDDX 


0. 


,0* 


Parents 


2. 


5 • 


Other relative 


7. 


3 


Notice in school 


1. 


8 


Pamphlet, newspaper, or magazine 


0. 


2* 


Other 


1. 


2 


-r J . b/ 
Ind e t ermma t e— 


6. 


4 


c/ 

Total percent- 


100. 


0 


Total N (freighted) 
Total N (unweighted)—"^ 


18,999 
2,763 







NOTE: Table based on responses to BSQ question 51. An asterisk (*) 
indicates less than 20 (unweighted) cases . For approximate 
standard errors, refer to Table 6.1, Column A. 

a/ 

— Percentages are- based on weighted responses, adjusted for instrument 
nonresj)onse , 

b/ ^ . 

— This represents primarily item nonresponse (i.e., failure to answer 
an item), but also includes multiple responses, out-of-range responses, 
and inconsistent responses - 

c/ 

— Percentages may not total to 100 due to rounding error. 
— ^ Numbers do not include instrument nonrespondents . 
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recruitment was carried out in most of the visited projects by a "contact 
counselor" in the feeder high schools. That counselor * :ally forwarded 
names to the UB staff, and often helped students to com^^^ece the UB appli- 
cation form and other materials. Moreover, the enthusiasm expressed by the 
UB participants at most visited sites made chexn natural recruiters for the 
program. On--site student interview's with UB students were equally indica- 
tive of the value of UB students as progrv-am recruiters, but the extent of 
their Ttivolvement in this activity appeared co be a function of their 
enthusiasm for the program, which varied from project to project. 

IV. PARTICIPATION IN AND EVALUATION OF UB ACTIVITIES 

A wide variety of activities may be ofiered by a given UB project — 
different kinds and levels of classes, different forms of counseling, 
different approaches to provision of tutoring, etc. An examination of the 
diversity of offerings of different activities has been presented in 
Chapter 5 from the point of view of the project director; however, the 
availability of an activity at a project does not insure that large pro- 
portions of st.idents will participate in the activity, nor do6:s it neces- 
sarily insure . >.aL those students who do participate in the activity ulU 
be helped. This section wixi, therefore, examine the reported rate of 
participation in variou.^ program activities on the part of UB students, and 
evaluations of the helpfulness of those activities by participating students. 

A.. Availability of and Participation in ^JB Activities 

Table 6.4 presents the UB students' reports of the availability of 
specified UB activities and the rates at which they reported participation 
in these activities.-^ The first column of the table shows the percentages 

3/ 

— Although the list of activities presented is the same as that pro- 
vided in Table 5.2, comparisons between the two tables is not recommended 
sincQ the values given in Chapter 5 are estimates of proportion of projects 
reporting availability of the activities and the values presented 7.n this 
chpater are estimates of the proportion of students tro whom the activities 
are available. Availability of an activity at only a few large projec^.s 
could make an activity avn^'i -^e to a relatively large number of students. 

287 



6.7 



Txbla 6.4 

AVATJOBCITT CF ACIHiTl£S STOJarS AHO lATCS 07 TBZIJL PAJtTlCIPATHW 



1. 
2. 
1. 
4. 
5. 
5. 
7. 
9. 

U. 
12. 
i3. 
14. 
15. 

16. 
17. 
18. 
19, 

20. 

n. 



23. 



Castsm la lapnrrint raadinc 
K*mdl&l Ea^llvh <:otirMa 
Ocimr Ea^llsh covts«s 
1t<afti21«l Hstbtaazlcs course • 
i^tbar MathrJistlcs coors«s 
C9uxai>«& aa h«rieji«« of alaorlcy groupn 
54Clsl Sclanctw c«ars«« 
ftfrci^ LsatuAc* ccfirs«« 
Kualc cours«9 
Art course 

Special interne coorMa (such aa pfaocosraphy, hoc rod, etc.) 
ClMaca la praptzing for coUafa cx£alaa;U<:iaft (auch Aa SAT or ACT) 
CXuasa in le«ruinf hov to atu4r 
CoursM trii^c la (no Ua^gca 
Clua*a oo bvm to takf t«ica 

•TOTORIWC 

Tutoring b7 prvf*r3lotMl taa^vra «n4 c&tMalors 
Tutorial 'ay colle^ft acuJ«nt« 
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TuCoris^ by ociiera 
COUMSILIXG A^I P O'.Tg^ .TT^LP 
lodlvliiual couzxs*4Ua3 on p«r»roal plt^4^1«M 

Ccimarllng on vocr^loo or ca>:«r baar aulttd t» yow- abllltlaa 
acd interca: 

CcunaeliA; or. academic problvsA 

Visits on one or aora colleges or other kchowla 

Information and ccimaalioi about reiui-rewiaca, coete end flnenclal 
aid fcr collegac or other cypea of acfcooU 

Help la chooelag a collate or vocacloaaX, cechnlcAl tch^ii 

Hjlp Id applying to collrgea oi vocaelonel, tt-ctalial achoolu 

Halp la applylog for flnaaclAi aid 

Uelp in f India g jobs 

OTHER Acrrnrtts asp setivices 

Sporca 

Social gatharinga 
Cultural actlvitiea 
Kedlcal and dencd ai«r/lces 



Artlxlty 

Hoc 
Aymllr.fcla 



10.0 
12.5 
12.1 
10.9 
13.3 
30. e 
22.7 
*3.6 
36.2 
21.2 
31.6 
29.8 

3a. 5 

63.8 
51.3 

17.3 
17.1 
3A.^ 
32.8 

23.6 

19.6 
17.0 
20.2 

12. C 
13.7 
13.0 
12.6 
36.7 

8.8 
6.3 
5.? 
21.1 



ActlvlC7 
Av^abl* 

but did xnoK 
?artlcln<ee 



FerceBCeK»- of Stodenca 



18.7 
18.7 
22.9 
20.6 
17.7 
19.3 
20.3 
23.3 
30.3 
33.4 
28.8 
18. 6 
12.0 
12.4 
10.4 

13.4 
14.6 
16.2 
15.4 

23.3 

16.5 
16. a 
14.3 

16.4 
20.3 
24.9 
24.1 
20.2 

17.3 
8.1 
6.6 

16.0 



AcclTtty 
Pertlclpa<»d In 



65.7 
Cl.l 
57.2 
57.6 
59.8 
35.6 
47.8 
23.2. 
24.9 
36.0 
30.2 
42.8 
40,8 
12.5 
29.4 

56.3 

58.1 
37.4 
39.2 

46.3 

3^.9 
36.3 
33.8 

63.7 
3C.e 
34.2 
35.3 
33.0 

65.9 ' 

76.9 

78.4 



Col'isn C. 



lade* 



t er»lo4f y; 



b/ 



3.6 
7.7 
7.8 

JO. 9 
9.Z 

li.3 
9.3 
9.0 
8.7 
9.4 
9.4. 
tf.8 
8,7 
9.2 
3.5 

11. Q 



Table ba^ed ax reapooaea to BSQ qu<«*tl«u 55. For appD^xlMta acandard errora, refer to Table 6.1 
a/ ?erc«ntes»a ere ba^ed oo «<elghceii rcepor^ea, adjoated for i natru«ene n<mr>.e^ onee. 
b/ 17,1. reptea«ue primer: !> it.m reepcne», but tleo lacludcw multiple, o— of -rang., end In.onaletenc rccpoaa^a 

- ";:n:jrH^ 2!76n:it^t.i?2di2; tt.::s^^"n:::^:;onii:t:)!" " ^ ^--^ - • « «^ ^^'^^^ 



ICO.O 

lor.o 
100 .i; 

103.0 
100.0 
100.9 
100.0 
100.0 
100.0 
100.0 
100.0 
lOO.O 
100.0 
100.0 
100.0 

100.0 



10,3 


100.0 


12.3 


ItiO.O 


12.7 


100.0 


6.5 


100,0 


7.1 


100.0 


9.9 


100. 0 


U-6 


100. c 
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100.0 
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100. a 
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100. 0 
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100.0 
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lUO.O 




100.0 




100,0 


8,8 j 
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288 

5.8 



of UB students who stated that the given activity was never available to 
them at any time in their UB participation. The second column shows the 
proportion of UB students who reported that they had not participated in an 
activity although it had been available. The third column presents the 
percentages of students reported they had taken part in the given activity. 

It can be seen that, among the various courses listed, such basic 
subjects as reading, remedial English, English, remedial mathematics, and 
mathematics were reported as having been commonly available, with only 10 
to 13 percent of the students reporting unavailability. (It cannot be 
assumed, however, that all of. ::the rexnaTiiing students did have access to 
such courses, since 6 to 11 percent of the students failed to answer or 
gave unusable answers for these activities. The indeterminate response 
rate for an item must be taken into account in interpreting the percentages 
reported for all other activities as well.) Large proportions of students 
(57 to 66 percent) responded that they had participated in such courses, 
and approximately 20 percent said that whereas these courses had been 
available, they had not taken them. These nonparticipants may represent 
students who did. not need such instruction, those whose -other needs were 
more paramount, or those who had not been with the program long enough to 
have participated. 

As expected, the availability of, and participation rates -^-iti, the 
remaining courses were less and showed greater variation than the basic 
courses. From 21 to 66 percent of the students reported that the other 
listed courses had been unavailable. From 10 to 33 percent reportedly had 
access to such courses but had not enrolled, and from 13 to 48 percent had 
taken them. The type of course most commonly reported as having been 
unavailable, and participated in least frequently when available, was 
"courses taught in two languages." This result is expected, since only 
projects including students from non-English speaking backgrounds would 
have reason to offer such courses, ar^d when offered only such students in 
the project would have reason to attend. 

Tutoring by professionals and by college students (probably tutor- 
counselors for the most part) was reported not available by 17 percent of 
the students. Some 15 percent of the students had access to such tutoring 



289 



but had not participated, and about another 57 percent had received such 
tutoring. Tutoring by others, including other UB students, was less commonly 
available and fewer students reported having participated. 

Personal, vocational, and academic counseling, as well as help in 
areas related to postsecondary entry were reported as unavailable by 12 to 
24 percent of the students. From 14 to 25 percent reported that such help 
had been available but had not besn used. Participation rates for such 
activities were from 47 to 64 percent* Help in finding jobs was less 
common, with about a third of the students reporting unavailability and 
another third reporting participation. 

Sports, social gatherings, and cultural activities were the activities 
least frequently reported as unavailable (6 to 9 percent). Seven to 17 
percent reportedly had found these activities available but had not taken 
part. From 66 to 78 percent of the students indicated they had participated 
in such activities — participation rates that are even higher than the rates 
for the basic courses, tutoring, or counseling. Medical and dental services 
were reportedly unavailable to 21 percent of the UB students; 16 percent 
reported access but not use; and 54 percent had received such services. 

In summary, UB students reported the common availability of and parti- 
cipation in such activities as basic courses in reading, English, and 
mathematics; tutoring; counseling; and athletic, social and cultural func- 
tions. This is consistent with reports by the staff (Chapter 5) that 
tutoring, remedial instruction, counseling, and cultural enrichment were 
among the most emphasized functions of the UB projects. Observations of 
the general availability of these activities were also made during the site 
visits. 

B. Perceived Helpfulness of Activities 

The UB students were asked not only to indicate whether they had par- 
ticipated in the specified activities, but also to rate the helpfulness of 
the activities in which they had taken part. The results of these ratings, 
are presented in Table 6.5. The statistics presented in Table 6.5 were 
computed only for those students who reported participating in a given 
activity. The table gives the percentage distribution of students by their 
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T«ble 6.5 

RATIKCS Of BELPrCLKESS OF UPWARD BOUSO ACTIVITIES BT PARTICIPATING STUDENTS 
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"01 Llccle 
or Ho Hslp *^clped n 
Somwihat ' 



P»rgcnt»Kg-^ of Participating Sttidentw 



E^alxaatloo cf Activity 



**B«lped BC 
■ lot ** 



Total 



Total 
Ninibcr of 
Cmams 



Madltn 



Standard 
Error of 
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COURSES 

1. Cotmn in laprovinc raadias 

2. RaMTlial gnglfab courses 

3. Ochar Zosliah couraaa 

4. Scaadial Math«aatic« conrsaa 

5. Ochar Mathaoadca cottraas 

6. Couraea oo barltasa of Bicorlcy froopa 

7. Social Scitncsa couraaa 

8. Porel^a Language coursaa 

9. Hnaic couraes 

10. Art couraea 

11. Spaclal Istcreat couraaa (auch as photo^wphj, 
hot rod, ate.) 

Claaaaa In praparlng for coUata a»«iaaciona 

(9\ich w SAT or ACT) 

13. Claaaaa in laaraint to atndy 

14. Cooraea tattle la tvo languafiu 

15. Claaaaa oo boir to taka taata 

TTrroRiw; 

16. TatorlnS ty profcsaional taachcra aimI cotn\aalori 

17. TotoTlns coUaga aCtidcata 

18. TutoriJiS iJ othar acudasta io tba prosra* 
IS. Tutorial b7 ocbara 

CQCWStLIWC AyP^OTHBl HELP 

20. lodivldtial cou&aaling on paraonal ptoblana 

21. Counadlii^ on vocation or carcar beac a^tad to 

r^T abiliciaa and intareat 

22. Counacling on acadaslc problaaa 

23. Viaita on ona or «ora collages or othar acbooZ< 

2^* InfonacioD and counseling about rs^^rsBants, coata, 
and financial aid for eollagea or otbar typea of 
achoola 

25. nalp la cbooiing a collage or vocacioaalr cachnlcal 

acbool 

26. Help la applying to coUagaa or vocational, technical 

acbool 

27. Help in applying for financial eld 
2B. Help in finding jofae 

glHER ACTIVITIES AWP SERVICES 

29. Sporte 

30. Social gecberinga 

31. Culcural eccivitiea 

32. )1adical and dentel aarvicea 



7.5 
10.9 
11.6 
U.7 
U.A 
16.9 
16.0 
21.1 
24.5 
24.7 

16.2 

10.5 
17.2 
32.0 
15.4 

8.3 
12.4 
26.7 
22.2 

19.0 

16.9 
15.a 
13.0 

10.4 

15.3 

13.8 
11.2 
32.9 

13.5 
13.4 
9.6 
17.5 



49.8 
51.8 
45.2 
47.6 
44.6 
44.8 
49.2 
47.4 
45.8 
4S.3 

41.4 

40.6 
43.6 
40.0 
44.6 

41.7 
48.0 
49.5 
50.2 

45.8 

43.3 
48.7 
41.6 

41.6 

41.9 

35.0 
32.9 
38.3 

42.8 

;5.o 

36.9 
37.1 
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37.3 
43.1 
40.7 
44.0 
38.3 
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31.5 
29.7 
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48.8 
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28.0 
39.9 

49.9 
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23.8 
27.5 

35.2 

34.8 
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10863 
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948 
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8S60 U39 
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14567 ai3 
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2.26 
2.35 
2.30 
2.37 
2.24 
2.19 
2.06 
2.06 
2.06 

2.32 

2.47 
2.25 
1.95 
2.28 

2.50 
2.28 
1.97 
2.05 

2.78 

2.19 
2.29 
2.39 

2.45 

2.33 

2.52 
2.61 
1.95 

"2.35 
2.31 
2.57 
2.37 



2.35 
2.26 
2.32 
2.29 
2.33 
2.21 
2.13 
2.06 
2.05 
2.05 

2.26 

2.38 
2.22 
1.96 
2.25 

2.42 
2.27 
1.97 
2.05 

2.16 

2.18 
2.20 
2.32 

2.38 

2.27 

2.37 
2.45 
1.96 

2.30 
2.28 
3.44 
2.28 



0.03 
0.03 
0.02 
0.02 
0.03 
0.03 
0.04 
0.04 
0.03 
0.03 

0.04 

0.04 
0.04 
0.06 
0.04 

0.03 
0.03 
0.03 
0.03 

0.03 

0.04 
0.04 
0.04 

0.03 

• 0.04 

0.03 
0.03 
0.04 

0.02 
0.03 
0.02 
0.05 



WnZ: Table baaed on reaponaee to BSQ 55. For epproxinace ecandard errore of parcenta. refer to Table 6.1. Colwm D. The atetiatice 
reported In thla cable ware covputad only for cbat at^sat of atudanta who indicated thny had participated in a given ectivity. 

Percentagee are baaed on weighted raaponeee, edjusted for laatruaant nonraapooaa . 

Parcancages auy not Cocel to 100 due to rounding error. 

Iluabere exclude inetruaen't nonreepondents and raMpondanta who reported not heving participated in each activity. 

d/ 

- Median end naan raclnga are baaed on a ecelc of I ("of little or no help") to 3 (''helped ae e lot"), "od are coaputed for dccaralnate 
reapoonae only, without edjuaraant for itca nonraeponite or Indeterminate reaponece (auitiple, out-of-range. or inconeisteot reaponaee). 
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ratings of each activity from little help to much help as well as the mean 
and median ratings (based on a scale of 1 for little help to 3 for much 
help). 

The majority of students who had participated in given activities were 
fairly positive about the help received. At least two-thirds of the parti- 
cipating students reported each activity to be at least somewhat helpful 
(i.e., gave a rating of 2 or higher). For each listed activity, however, 
some students (8 to 33 percent reported little or no help as a result of 
their participation. The three activities which were rated the leas t 
helpful (receiving the lowest mean ratings, of 1.96 or 1.97, and being 
rated as of little or no help by 27 to 33 percent of the students) were 
courses taught in two languages, tutoring by other students in the program, 
and help in finding jobs. All three activities were also characterized by 
relatively low participation and availability rates, as previously shown in 
Table 6.4. 

The activities reported as most helpful by the participating students 
were tutoring by professional teachers and counselors, help in applying for 
financial aid, and cultural activities. Each of these three activities was 
rated by over half the participating students as having helped considerably 
and rect:ived a mean rating of from 2.42 to 2.45. 

Among the 15 types of courses and classes listed, the 5 basic courses 
(items 1 through 5), classes on taking tests, and classes in preparing for 
college examinations were reported as being more helpful than the renir.ining 
courses (which ai e less basic academic courses or special interest courses). 
These results suggest that the UB courses in basic subjects and test skills 
were more appreciated by participating students than the other, less basic 
courses. However, from 8 to 12 percent of the participating students 
reported that the basic courses were of little or no. help. 

Among the tutoring activities, tutoring by professional teachers and 
counselors was rated the most helpful (mean rating of 2.42) by participating 
students. From 8 to 27 percent of these students reported the various 
tutoring activities as of little or no help, with tutoring by other students 
in the program seem as least helpful. 
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The three types of counseling listed were all reported as being moder- 
ately helpful (mean ratings of 2.16 to 2.20), and activities related to 
information and application for college entry and financial aid were all 
rated somewhat higher (from 2.27 to 2.45). Consonant with the impression 
gained in the site visits in this area, relatively little emphasis v;as 
placed on the choice of an appropriate school, this activity was perceived 
as the least helpful of the postsecondary preparatory activities. From 10 
to 19 percent of the participating students found the counseling and post- 
secondary preparation activities as being of little or no help. 

One of the "Other Activities and Services", cultural activities, was 
rated as being among the most helpful of all activities (mean rating of 
2.44). The other activities in this category were also seen as helpful 
(mean ratings of 2.28 to 2.30). Only 10 to 18 percent of participating 
students stated that these activities were of little or no help. 

In summary, the activities reported by UB students as being readily 
available and having high participation rates (i.e., basic courses, tutoring, 
counseling, activities related to entry into postsecondary education, and 
such cultural enrichment activities as sports, social gatherings, and 
cultural events) were also the courses and activities that participating 
students rated as most helpful. As specified previously, these were the 
areas that UB staff members reported as the most emphasized functions of 
their projects. 

V. EVALUATION OF ASPECTS OF PROGRAM OPERATIONS 
IN THE 1973-74 PROGRAM YE/vR 

Table 6.6 presents the evaluation of various aspects of program opera- 
tions during the summer of 1973, made by those UB students who reported 
having participated in that session (a,bout 84 percent of the UB students). • 
The topics evaluated included the content of curriculum, quality of admin- 
istration, and staff and student interrelationships. The table presents 
the percentages of students who rated each item on a five-point scale of 
"poor" to "excellent" or who answered that the item was not applicable. 
The table also shows the median and mean ratings based on this scale of 1 
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for "poor" to 5 for "excellent," with a middle point of 3 for a "don't 
know" answer. Table 6.7 presents the evaluation of the same program aspects 
for the 1973-74 academic year program; but unlike the previous table, it is 
based on the responses of all UB students (all had participated in that 
academic year session, by definition o£ the sample of BSQ respondents). 

In comparing the two tables, it is seen that the rate of item nonre- 
sponse and indeterminate response is about the same in both tables (from 
7.7 to 9.9 percent in Table 6,6, and from 7,7 to 11.4 in Table 6.7), But 
the proportion of respondents answering that an item "does not apply" is 
greater for the academic year program than for the summer program (from 2,8 
to 7,2 in Table 6.7, and from 0.5 to 3,2 in Table 6,6),—^ Thus, the ratings 
of the aspects of the summer program are based on a slightly higher propor- 
tion of the eligible respondents. 

The specified aspects of program operation were rated quite good, on 
the average, for the 1973 summer program; however, from 10 to 44 percent of 
the students saw given aspects of the summer program as no better than 
"fair." The highest mean ratings, 4,11 and 4.16, were accorded to staff 
members' interest in students and the way staff members got along with one 
another. The lowest ratings, 2.93 and 3,12, were given to the amount of 
student stipend and parents' participation. The teaching, counseling, and 
administration by staff were given high average ratings (3,80 or above), 
while aspects of selecting and recruiting students were rated slightly 
lower (less than 3,65). Discipline by students (mean score of 3,48), 
interestingly enough, was rated lower than discipline maintained by the 
staff (mean of 3,85), Interpersonal relationships between students and 
staff, among students, and among staff, were all rated quite highly 
(3.79 or above). The students' high opinions of these relationships are 
consistent with those of the staff, as previously reported in Chapter 5 and 
with student reports during site visitation. 

These same 16 aspects of the 1973-74 academic year program, presented 
in Table 6,7, received somewhat lower average ratings (ranging from 2,99 to 
4,07). But the pattern of the average ratings of academic year elements 
4/ 

- This difference probably reflects the greater variability of program 
content in the academic year. 
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was similar to the pattern, discussed for the summer program (i.e., the 
program elements were rated similarly relative to one another). Also, the 
percentages of students reporting various aspacts of the academic year 
program as "fair" or '|poor" covered about the same range as that observed 
for the summer program (10 to 39 percent) . 

In summary, the responses of the students depict a program in which 
central functions and day-to-day operations such as teaching, couuoeling, 
and administration (including discipline) were perceived to be well con- 
ducted, and whose best qualities were rooted in certain human interactions, 
the staffs' interest in the students and the staffs' ability to get along 
with one another. Other features of program administration, such as selec- 
tion and recruitment of students, were not rated quite so highly. The 
features perceived as being the poorest (in a relative sense) were aspects 
which were in whole or in part beyond the control of the staff, namely, the ' 
amount of the student stipend and the parents' participation. The operation 
of the summer program was seen in a slightly more favorable light than that 
of the academic year program. 

It is quite likely that the absolute ratings assigned to aspects of 
the program reflect, in part, in part the "halo effect" (a. tendency to rate 
highly all attributes of something that has high overall attractiveness or 
appeal), due to the students' general high enthusiasm for the program which 
was fairly consistently observed in the site visits. The ordering of the 
perceived effectiveness of aspects of program operation, however, should be 
less confounded by such au effect. In a very general sense, the orderings 
obtained were in accord with the unstructured comments of students inter- 
viewed during site visits. The summer program, typically including residence 
on a college campus, was seen as a "better" program, and interpersonal 
relationships among project staff and students were frequently mentioned as 
a very positive aspect of the students' participation in the UB program. 

VI. STUDENT BENEFITS 

The UB students were asked to specify, for each of 12 potential bene- 
fits they could gain from being in UB, how important each was to them, and 
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the extent to which it had been received. Since the utility to the student 
of a received benefit is partly a function of the importance attached to 
that benefit, the responses regarding ^'importance" were cross-tabulated 
with those concerning ''amount received." The resultant joint distribution 
of importance and receipt of each benefit is presented in Table 6.8. The 
table also provides, for each potential benefit, subtotals of the percent- 
ages of students reporting each degree of importance. 

The rate of indeterminate response reported in Table 6.8 is relatively 
high, ranging fron? 17.1 to 21,2 percent. One reason for this high rate was 
that students who failed t.o answer either "how important" or "how much 
received" were considered as not answering the item. With th ^e relatively 
high item nonresponse rates, the resi^lts presented in Table 6.8 are likely 
to be subject to bias and should be viewed with caution. The following 
discussion assumes that the results wer-a not materially affected by any 
item nonresponse bias that may exist. 

All of the 12 potential benefits were reported as being at least 
iTiOderately important by no less than 69 percent of the students, and no 
more than 13 percent of the students reported any potential benefit as not 
importanc. Comparing the ratings of importance of the various benefits, it 
is seen that benefits more directly related to major goals of UB (con- 
tinuance in high school and pursuit of posts econdary education) were gener- 
ally regarded by the UB students as being the most important. Benefits 
more tangential to these goals were rated as being less important. 

The benefits reported as "very important" by the highest proportions 
of students (62 percent in each case, and henceforth termed the "most 
important" benefits) were becoming prepared for postsecondary education and 
gaining a better understanding of the need for education.—'^ Benefits next 
most frequently rated as very important (by 55 to 59 percent)-^'^ included 
benefits primarily related to personal and interpersonal growth (e.g., 
self-understanding, self-expression, understanding people of other cultures 

Correspondingly small proportions (1 to 2 percent) rated these 
benefits as not very important. 

-^^ From 2 to 4 percent regarded these items as not very important. 
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or races, and learning to meet aud interact more harmoniously with other 
people)* One of these relatively important benefits was learning to study 
better. Therefore, the benefits second in importance relate to the develop- 
ment of a variety of skills and of maturity, all of which would be helpful 
in continuing in school and acquiring higher education. 

The benefits regarded as among the least important were rated by 39 to 
49 percent of the students as very important and 7 to 13 percent as nor. 
very important, (thus the characterization of potential benefits as most to 
least important is seen to be quite relative) • These benefits form a 
miscellaneous group, including one that had originally been intended to be 
rather trivial (i.e., to "have a change from the routine of my regular 
school"). Even though this was one of the least important benefits, some 
71 percent reported it as being at least moderately important. This may 
indicate that some students may have participated in UB partly to escape 
the monotony of their schools, and subsequently rationalized their motiva- 
tion by viewing the benefit as ^important. On the other hand, the Student 
Instrumentation Panel advising this study pointed out that the dullness of 
school for many UB students was such that this benefit genuinely represented 
a meaningful part of the UB experience. 

Two of the other least important benefits were making close friends 
and learning about the students' own racial or ethnic heritage. Site visit 
observations and the Student Instrumentation Panel had indicated that one 
common outcome of the UB experience was for formation of good friends. 
This was not rated by the UB students, however, as one of th^a most important 
benefits; and indeed, it is only an indirect goal of the UB program. 
Learning about the students' own cultural heritage, also an indirect goal 
of UB, may not have been as important to white students as to others. 

Another of the least important benefits was increasing students' 
participation in extracurricular activities in school. Although some may 
hope that UB would interest its participants in regular s.chool to the 
extent of becoming more active in school life, this apparently was viewed 
by students as relatively unimportant compared. to the other benefits. 
Finally, obtaining financial aid for needs not provided for by UB was also 
one of the least important potential benefits; the highest percentage of 
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students across items felt it was not very important. Although this 
benefit is related to an indirect rather than direct UB goal, the relative 
unimportance of this benefit may be partly due to the necessity, reported 
during site visits, of the most poverty-stricken students to work and 
therefore not to join UB or to drop out of the program. 

The extent to which pot ential benefits given the degree 

of their importance, can be observed fron ^nerally, the 

amount received is directly related to tl. .t .e. That is, the more 

important a benefit the more likely it was to be reported as received at 
higher levels. While the general relationship can be seen in the joint 
distribution presented in Table 6,8, the discussion below will cite condi^ 
tional p ercentages (i.e., the percentage of students receiving a specified 
amount of a benefit, given the degree of importance attached to it) that do 
not appear directly in the tabular presentation but that can be calculated 
from the statistics in the table;^"' Such a percentage is easily computed 
from the entries in Table 6,8. For example, among the 3.1 percent of 
students who saw gaining a better understanding of themselves as not impor-- 
tant, 61 percent of them (100 x (1.9 t 3,1)) reported receiving little or 
none of the potential benefit. 

In general, students who regarded benefits as not very important 

tended to report receiving little or none, or, to a lesser degree, receiving 
7 / 

moderate amounts.- Similarly, the majority of students (65 to 74 percent) 
who viewed benefits as moderately important reported having received them 
moderately. Finally, for nearly all benefits, the majority of students (56 
to 70 percent) who regarded a benefit to be very important also responded 
that they had received much of the benefit. 

The relationship was not as strong in the latter case, however. Con^ 
siderable proportions of the students who thought a benefit was very 
important also reported receiving only moderate amounts. This was espe- 
cially true with respect to learning to study better, in which only 47 

Although no more than 13 percent reported any benefit as not impor- 
tant, it is interesting to note the cases in which students received more 
than "a little or none'* of these unimportant benefits. The most marked 
cases were making close friends and having a change from the school routine 
for which only 29 percent of the students rating them as not important 
also received little, 
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percent of those rating it as very important reported having received much, 
and 44 percent reported having received it moderately. Thus, these students 
viewed this skill, which is basic to the UB mission, to be among the most 
difficult to achieve at a level commensurate with their high desires. 
Another benefit with a relatively high degree of discrepancy between impor- 
tance attached to it and amount received was obtaining financial help for 
personal needs. Of the students responding that this was very important, 
47 percent reported receiving much; 30 perce^ rece^ ' it moderately; and 
24 percent received little or none. The limited financial resources of UB 
projects for providing such aid probably accounts lur this discrepancy. 

The type of discrepancy (between the importance of a benefit and the 
amount received) which would seem intuitively most disappointing to the 
students would be the case of receiving little or none of something very 
important. This situation was not infrequent, since 10 to 30 percent of 
those students rating a benefit as very important also reported having 
received little or none. The percentages were greatest for learning how to 
study better and being prepared for postsecondary schooling, for which 29 
and 30 percent, respectively, of the students who reported high importance 
received little. These discrepancies are noteworthy because these benefits 
are basic to UB's purpose. Other potential benefits for which a considerable 
proportion (19 to 26 percent) of the students who regarded them as very 
important received very little include: learning more effective self- 
expression, understanding better other cultural or racial groups, partici- 
pating in extracurricular activities in school, learning and appreciating 
the students' heritage, and obtaining personal financial help. The last 
benefit is generally b»?,yond UB projects' capability; but the other three 
benefits, though not direct UB goals, were nevertheless important aspects 
of the UB experience for these students. 

Because the relationship between importance of a potential benefit and 

the amount received was direct, the benefits most students perceived as 

very important were also generally received in high amounts, though not 

8 / 

necessarily the highest amounts.— With the exception of obtaining 



— The percentage of students reporting having received any potential 
benefit to any specified degree may be obtained by summing the appropriate 
columns of Table 6-8. ^ r^ 
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personal financial help, no more than 15 percent of th^ students reported 
having received only little or none of any potential benefit.-^ Excluding 
..this benefit, 66 to 78 percent of the students reported having received the 
other benefits in at least moderate amounts. The percentages of students 
reporting at least moderate receipt of the benefits most directly related 
to UB's goals were 72 percent for becoming prepared for postsecondary 
education and 78 percent for gaining a better understanding of the need for 
education. Learning to study better, a skill related to the other two 
benefits, was also reportedly receive' 'i at least a moderate level by a 
high percentage of students (72 r^^ appears that the majority of 

the UB students felt that they wei ping skills and attitudes necessary 

for continuing their education and pursuing higher education. 

In summary, UB students felt that benefits most central to the purpose 
of UB~the pursuit of postsecondary education — ^were the most important; 
next in importance were benefits that facilitate the pursuit of education, 
such as personal and interpersonal growth. The majority of students reported 
having received all listed benefits, in at least moderate amounts. The 
amount of a benefit students reported , receiving was generally commensurate 
with the degree of importance they attached to it. The relationship between 
rated importance and rated receipt of a benefit may be due to a tendency of 
people to consider that which they have obtained as more important than 
that which they have not. 

An even more indirect benefit that students could derive from partici- 
pating in UB is explored in Table 6.9. This table presents the judgment of 
UB students about whether persons at their schools, their relatives, and 
people in their community had changed their opinions of the students as a 
result of their participation in UB. These data should be treated with 
more than ordinary caution because the UB students were required not only 
to make subjective judgments, but to make them regarding other person's 
opinions of them (the students). The results are of some interest, however, 
because it has been suggested that a side effect of UB could be to enhance 
or worsen the image of its participants in the eyes of those around them. 
As seen in Table 6.9, for any of the persons considered, substantial 



1/ D 11 

Recall, however, that the item nonresponse rate was about 18 percent 
for all benefits. 
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proportions (30 to 50 percent) of the UB students reported no change in 
opinions, and generally more students reported no change than reported 
either a positive or a negative change in the opinions of others. The one 
exception was parents in which case 56 percent of the UB students reported 
their parents as having an improved opinion of them. Excepting parents, 
only 27 to 39 percent of the UB students felt that their participation in 
UB had a favorable effect on changing the opinion of various people about 
them. Only a small proportion (less than 3 percent) of the UB students 
reported that others thought less of them as a result of their participation 
in the program. Thus it appears, that at least as reported by the UB 
students, their participation in UB had exerted no major effect in improving 
their image in the eyes of most othe d around them. 

VII. SUMMARY 

This chapter has described the perceptions of the UB program as reported 
by a subgroup of participan.ts i i.e. . BSQ respiiindents) . These students had 
participated in varying num - -s of Z5 sessions, from only one academic year 
session to nore than three suil :aer 3nid academic, year sessions — with a 
median length of program parrJ.c±=:St-an of less than one year. Most frequently, 
these students reported havi::%'_ ^rrst heard of the UB program from other UB 
students or from school guiidancie counselors. 

Accorziing to the stude^.ts'^ reports, the activities (of those 32 speci- 
fied) tharr had been most concaonly available to them were also the ones 
characterized by the highes: rpartiL-zlDation rates among students to whom the 
activities had been availabiw . These include such basic courses as reading, 
English, and mathematics courses, as well as tutoring-, counseling, and 
athletic, social, and cultur^^ activities. These were alsc :::^e activities 
that the participating stude>*- r^r ed as most helpful to them. The common 
availability, participation, exxd r-^ported helpfulness of thesc activities 
are in accord with the staff - -^iszt that tutoring or remedial instruction, 
counseling, and cultural enricbmerrt were three of the most emphasized 
functions in UB projects. 

From a list of 12 benefitu pcnteatially obtainable from the UB experi- 
ence, the benefits most directl-r r-iated to two of the major goals of UB 

3 05. 



(continuance in high school and pursuit of postsecondary education) were 
reported by the students as being the most important to them. These 
included the benefits of gaining a better understanding of the need for 
education and of being prepared to attend college or other types of schools. 
Benefits more indirectly related to major goals were next in importance, 
such as personal development and interpersonal growth • The majority of the 
students also reported having received these benefits, as well as others, 
in at least moderate amounts. Generally, the more important a benefit was 
to the students, the more likely he was to report having received it in 
higher amounts. Among the most important deviations from this trend were 
the considerable proportions of students who, although they viewed the 
benefits of learning better study skills and becoming prepared for post- 
secondary education to be very important, reported that they had received 
these benefits in moderate rather than in great amounts. 

The students' evaluation of 16 aspects of program operations in the 
1973 summer and 1973-74 academic year programs was also presented. The UB 
students' perceived the relative strengths and weaknesses of their projects 
in the two sessions similarly, although summer session operation was seen 
as slightly superior. Generally the central functions of UB and day-to-day 
operations (such as teaching, counseling, administration, and discipline) 
were well conducted in the opinion of the students. The UB students rated 
the staffs' interest in the students and .the harmonious relationships among 
the staff as the best qualities of the program. 

As seen in this chapter, the overall tone of the students' perception 
of the UB program is quite positive. This is in agreement with the percep- 
tion of the staff as reported in previous chapters and with the observa- 
tions made during site visitation. There are, however, some students (and 
in some cases rather sizable proportions *of them) who see certain aspects 
of the program in a less than favorable light. As many as 30 percent of 
those who had participated in certain program activities found such 
participation to have been of little or no help; certain aspects of the UB 
summer and academic year programs were seen as no better than fair by 
upwards of 45 percent of the UB participants; and some potential benefits 
of the UB program were seen as being received in small amounts or not at 
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all by 10 percent or more of the program participants, l^ile such negative 
results detract somewhat from the basically positive viev; of UB reported by 
most students, they should not be taken as an indictment of the program. 
It would be unrealistic to imagine that any program such as UB could be all 
things for all participants. It would be equally naive to suppose that all 
projects (particularly relatively new ones) perform all functions at peak 
efficiency -and maximum effectiveness. 

What does emerge from the student perception data is a picture of a 
program that is seen by the participants, as doing many things quite well 
and some things not as well. More importantly, in the eyes of the students, 
the program seems to be most successful in those areas more directly related 
to its stated goals, those areas which are reported by the staff as most 
emphasized, and those areas over which the staff have greatest control. 



307 



6.27 



Chapter 7 



Student Outcomes as a Function of UB Participation 

I . GENERAL 

Previous analyses, presented in Chapters A, 5, and 6, have focused on 
a description of the structure and function of the UB process. The major 

purpose of the study reported in this volume, however, if ..uxu 

possible relationships between UB participation and student outcomes. Of 
speciric concern are studen:t outcomes related to the three major objec- 
tives of the UB program: (a) to increase the high school retention rates 
of participants, (b) to increase, among participants, the rate of entry 
into postsecondary education (PSE) , and (c) to generate the skills and 
motivation necessary for success in educatzLon beyond high school. 

Difficulties in operationalizing the ...third major objective not- 
1/ 

withstanding,— this chapter addresses the differences between the UB and 
CS group on variables related to the three major objectives. Prior to 
presenting results of these comparisons, however, it is considered very 
important to clarify, and in some cases to reiterate, certain matters which 
are basic to the analyses. The two topics tc which reader attention will 
be directed in this .J-ntrnductory section are: (a) a specification of the 
major variables used in the analyses, and (b^ the approach to, and limita- 
tions of, the analyses. 

A. Variable Specification 

As previously discussed in Chapter 2, Section VII, the data available 
for the entire set of students were restricted to a small number of measures 
abstracted and distilled from the various student instruments. In addition 
to the lEsasures obtained from the STF, the variables of major concern in 
this chapter are those contained in the student Master File (see Chapter 3, 



— A dd.scussion of difficulties involved in defining and measuring 
variable, related to the third mandated objective appears in Chapter 1, 
subsectinn III,C.3. 
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subsection IV. A). A detailed definition of these variables is available in 
Appendix E; however, to insure that the reader is completely aware of the 

2/ 

nature and limitations of the primary measures referenced in this chapter,— 

brief descriptions are presented in this subsection. 

Poverty Level Index . Only a very gross index of family econcr:'. 

status is available from the data common to .^11 rudents. The inde t'*^ed 

is closely related to, but not identical to, ll*e iaderal poverty level 
3/ 

^ 'delirxes.— While the federal guidelines define poverty status as_a 
join± function of family income, family size, and family liocation (farm or 
nonfaxm) , the index used in this study is based on family Income and size 
only (since farm or nonfarm status is not available for aTi students). Further, 
ixdEonnation concerning family income as collected by the ±astruments usied 
in. rhis study gave gradations of income which are considerably less refined 
ttera those specified in the federal guidelines. It should also be noted 
the index used for this study was based on student reports of family 



s±i:3 and income, the latter, in particular, being subject to considerable 
ermr . 

Academic Risk Index . The academic risk status of a student was deter- 
mined on the basis of ninth grade academic information. The use of ninth 

grade information provides a time point which is "prior" to UB entry for 

4/ 

nearly all of the UB participants considered-— A student was considered 
to be an academic risk if his academic grade point average (GPA)— ^ was such 
that he would fall in the bottom half (50th percsntile or less) of his 



2/ 

— Some of the variables analyzed in this chapter come directly from re- 
sponses to specific items of specific student insrtruments. Such variables 
are defined by the questionnaire item itself (Appendix D) and warrant no 
further definition. Other variables are simple transformations of responses 
to specific questionnaire items and will be defined wban presented. 

3/ 

— Application Information and Program Manual (1972-73) ; Talent Search, 
Upward Bounds and Special Services . Washington, D.C.: U.S. Department of 
Health, Education, and Welfare, Education Division, Office of Education/ 
3ureau of Higher Education, December 1972, Appendix A. 

The possibility of using a time point corresponding to "year befor-2 
UB entry" was considered, but such a definition lacks meaning for the CS 
group and was thus abandoned . 

^ Academic GPA was computed from STF entrxes using "academic" courses 
only (see subsection I. A. 7 below and Appendix E) . 
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class.— ^ If academic GPA could not b-o computed (or converted to a percen- 
tile rank), then a student was cla^"^ ^'-^ ^is a- academic ris: ily in the 
event that he failed 20 percent : tj^e academic cour ^ch he 

attempted • 

High School Continuance/Completion Index Within School Year . An 
outcome central to this study is high school (HS) continuance or completion 
for the twelfth grade. One index of continuance/completion may be obtained 
within the 1973-74 school year by noting the HS enrollment status in fall 
1973 and spring 1974. Since all legitimate sample members were in HS 
during fall 1973 (see Chapter 3, subsection IV. B), a student reporting that 
he was either in HS or graduated from HS in spring 1974 was considered to 
have continued/completed during that school year . An assumption is niade, 
of course, that a student still in HS in April (the time of data collection) 
would continue throughout the remainder of the school year. This index is 
based on studen-.: self -^report, but was verified by reports of project or ' 
high school staff laembers. 

High Sch ool Continuance/Completion Index Between School Years . Another 
index was computed relating to HS continuance/completion from one school 
year to the next. This index is, in general, calculable only for the 
students providing fall 1974 data.-^ Although appropriate weight adjust- 
ments were made to account for the fall 1974 subsampling, the possibility 
of respondent bias remains (see Chapter 3, section VI). It should also be 
pointed out that the between school year HS continuance/completion index 
is based exclusively on unverified student self -reports.,. 

Fostsecon dary Entry Index , Indication of entry into PSE is obtained 
from all data available on the student through fall 1974, although it is 
primarily available from FSQ responses. If a student indicated entrance to 
any institution o£ pSE at any time subsequent to fall 1973, he is considered 



6/ ^ ^ 

— Transfer atxon of grade averages from various grading systems to 
percentile ranks was accomplished by use of a conversion table given in 
Appendix E. 

— In some cases, completion could be imputed from spring 1974 data. 
Specifically, a student who reported high school graduation ±n spring 
1974 would maintain his completion status in fall 1974, 
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to have entered PSE , regardless o£ whether he remained in that institution. 
Thus, the measure obtained does not reflect PSE persistence. With few 

exceptions, this index is based exclusively on unverified student self- 

. 8/ 
reports.— 

High School Equivalency Education Program Indices . The extent 
to which high school dropouts avail themselves of other alternatives for 
high school completion is of interest as a student outcome. One available 
alternative was measured by the student instruments, specifically High 
School Equivalency Education Programs (HSEEP) . Two HSEEP indices were 
constructed; the first indicates entry into HSEEP, while the second indi- 
cates successfnl completion of HSEEP (i.e., receipt of high school diploma 
or equivalent) . These indices are based exclusively on unverified student 
self-reports. 

High School Academic Measures . Information concerning HS academic 
performance is -available from the completed STF. Five measures of this 
academic performance were computed for each grade level from ninth grade to 
''current" grade (i.e., grade level in fall 1973). The five measures (based 
on eight reduced HS course information variables— see Appendix E) are: (a) 
normalized academic GPA; (b) proportion of attempted academic credits 
passed; (c) proportion of credits attempted that were academic; (d) propor- 
tion of academic credits attempted that were advanced; and (e) proportion 
of academic credits attempted that were remedial. 

With one exception, the measures are straightforward. The normalized 

academic grade point average is, however, a relatively complex measure. 

With the aid of conversion tables (see Appendix E) , average grades within a 

grade level wer^e transformed into a common scale of percentile ranks. The 

resultant percentile ranks were then converted to a unit normal distribution 

9 / 

with expected value of 5»-- This double transformation provides a common 
scale for different HS grading systems as well as a measure with excellent 
scale qualities. 



— Some instances in which PSE entry had been accomplished at the time 
of the spring 1974 data collection period (primarily in the case of early 
high school graduation) were verified by project or high school staff. 

9/ 

— • Thus, a pernantile rank of 50 mapped into a score of 5.00 and a per- 
centile rank of 5'5 nspped into a score of 6.96. 
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For analysis purposes, only the measures computed for grade 9 and for 
current grade are used (the full set of five ninth grade measures and 
change scores for all five variables from ninth to current grade) , These 
measures are based on official reports of academic performance. 

B. Approach to Analysis 

The approach to analysis used in this chapter is, in general, straight- 
forward; however, some of the analytic techniques used may be less familiar 
to the reader than others. This subsection provides a brief overview of 
the mechanics of analysis and conventions of data presentations that are 
common to this chapter. 

Use of S ampling Weights . To provide unbiased estimates of population 
parameters, sampling weights were used in computing the various statistics 
reported in this chapter. The raw sampling weight associated with a student 
is simply the inverse of the probability of selecting that student. The 
use of sampling weights overcomes possible bias in the resulting statistical 
estimates which may be introduced because students were selected with 
unequal probability (due to oversampling of specific groups), 

Balancinjg^. In order to provide more meaningful analyses of student 
outcomes, a balancing procedure was used to statistically equalize the UB 
and CS groups with respect to certain preprocess and extraprocess vari- 
ables. An example of the procedure is presented in subsection II. B below, 
and the technique is fully described in Appendix F. In essence, the 
balancing procedure forces an equivalence of the UB and CS groups in terms 
of characteristics which are related to outcomes but which have not been 
completely controlled by the study design (i.e., sex, race, academic risk 
status, poverty level status, etc.), thus bringing about greater compar-- 
ability of the two groups. 

Adjustment for Missing Data . In previous chapters, some discussion of 
weight adjustment for instrument nonresponse has been presented. Where 
instrument specific responses are used in this chapter (e.g., BSQ item 
responses), similar adjustments have been made. Such adjustments involve 
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an apportioning of the sampling weights of nonrespondents (those who were 
eligible for administration of an instrument but who did not complete it) 
among the respondents who are most like them (i.e., from the same project 
or school, and of the same sex, race, academic risk status, poverty status, 
and grade level). The Master File variables were obtained from many dif- 
ferent instruments, however, and adjustments for missing data were made for 
each variable considered. The technique used to adjust for item nonresponse 
is identical to that used to adjust for instrument nonresponse. 

Conventions of Data Presentation . Due to the central importance to 
the study of the analyses reported in this chapter, a generalized table of 
standard errors is not used. Rather, the standard error for each comparison 
is reported separately, either in tabular form or in the text. Exceptions 
to this general policy are cases in which differences in two proportions 
are less than 1 percent; for such cases, standard errors were typically not 
computed* Most comparisons between the CS and UB groups, in terms of major 
outcome variables, are made within grade level (i.e., tenth grade UB 
participants compared to tenth grade comparison students). Moreover, 
within grades 11 and 12, UB students are frequently partitioned into 
separate subgroups depending on the extent of their participation in the 
program. While this approach suffers somewhat from a loss of cases for 
analyses (data shrinkage due to lack of, or inconsistent, information 
regarding the classifier variables) , it is considered to provide much more 
meaningful comparisons within the model of educational continuance that has 
been adopted for this study. 

O; '^^ Limitations of Analysis 

Care was taken throughout the analysis to avoid comparisons which 
would introduce favorable or unfavorable bias toward the UB program. 
Considerable effort was made to insure that the data entering analysis were 
consistent (see Chapter 2, section VIII; Chapter 3, sections III through V) . 
The sample was designed to reduce many of the possible differences 
which could exist between the UB and CS groups (and which could, therefore, 
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lead to spurious group differences). Statistical equalization of the two 
groups was undertaken in an attempt to reduce contamination of results by 
possible preprocess and extraprocess differences. Weight adjustments for 
indeterminate response at the instrument and item level were employed in 
critical analyses in an effort to avoid distortion of the findings due to 
incomplete data collection. Standard errors were computed for all major 
differences so that probability statements concerning the populations of 
interest could be made and ''true" differences could be uncovered. 

Although it is quite likely that these efforts were rewarded, they do. 
not insure romoval of all possible confounding factors. Further, two 
probl ems that are inherent in questionnaire surveys remain • (1) the 
validity of the reported information, and (2) the inability to definitively 
establish causation. These problems are discussed briefly below. 
1. Validity of Data 

The preponderance of data is based on unverified student self-, 
reports. In addition to known biases in student reports (of such 
matters as high school grades, parent income, parent education level), 
invalid responses may be traced to a diversity of possible sources 
(e.g., deliberate attempts to mislead, lack of understanding or misin- 
terpretation of questions, and simple errors in marking responses). 
Previous examinations of data reliability (see Chapter 3, Section V) 
have indicated only a moderate degree of agreement between student 
self -reports and project (or school) reports within the small subset 
of data elements for which verification could be attempted. However, 
there is no reason to believe that other student-reported data would 
show any better agreement with reports from other sources. 

The problem of data validity may be compounded through the 
weight adjustment procedures, particularly when invalid data are 
coll ected from a student who is similar to a large group of non- 
respondents. The real danger of the validity problem, however, is 
that of differential validity of responses within the two groups. 
While a lack of reliability and validity serve to introduce error into 
the data, if this error is the same (regardless of direction or magnitude) 
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within the UB and the CS group, then group differences will show no 
directional bias. If, on the other hand, the data from one group are 
biased in a particular direction and those from the other group are 
unbiased (or biased in the opposite direction) , then the bias will 
remain (or be magnified) in the group differences. While there is no 
defensible reason to suspect that differential response biases exist 
between the two groups, the possibility of this source of error in 
group differences does exist. 
2. . Establishing Causation 

A logical error which is made with sufficient frequency to 
warrant discussion is that of inferring causality from an established 
relationship. While the existence of a relationship between two 
variables is a necessary condition for the existence of causation, it 
is not a sufficient one.-^*^ In addition to a relationship between two 
variables (conditions), establishment of causation requires that: (a) 
the causal variable (antecedent condition) logically precedes the 
effect (consequent condition); and (b) no other antecedent variable 
exists which may explain both the antecedent and consequent variables 
under consideration. While the first of these requirements is often 
fairly easy to establish, the second is extremely difficult to estab- 
lish outside the true experimental paradigm. Large advances have been 
made recently in the area of causal modeling in nonexperimental or 
quasiexperimental research paradigms; however, the assumption of 
inclusion of all relevant variables in the model is a basic tenet in 
these approaches. 

In the area of educational intervention programs, it would be 
extremely difficult, if at all possible, to identify (much less to 
measure) all the relevant student, process, and external factor 



— A well known example is the strong negative relationship that exists 
between the number of mules and the number of individuals with doctorates 
in a state. It is a statistical fact that states with the greatest number 
of mules have the smallest number of people with a Ph.D. degree, and con- 
versely. A policymaker concerned with increasing the number of Ph.D.'s 
in a state would be ill advised, however, were he to attempt to accompliish 
this by organizing a wholesale reduction in the mule population. 
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variables which may influence one another and/or student outcomes. 
Thus, even though strong associations are shox^ in this chapter 
between UB participation and certain student outcomes, the possibility 
still remains that these associations are largely a function of other 
unconsidered (or unmeasured) antecedent variables which are related to 
both student outcomes and selection of UB participants. 

II. PEIEPROCESS AND EXTRAPROCESS DIFFERENCES BETWEEN 
THE UB AND CS GROUPS AND RELATED ADJUSTMENT TECHNIQUES 

Throughout this volume, discussions of issues surrounding the compari- 
son of output measures for UB participants and a comparison group have 
stressed the importance of the equivalence of those two groups on relevant 
characteristics other than UB participation . The importance of this equiva- 
lence is perhaps best pointed out by reference to the comparison process 
model introduced in Chapter 2 (Figure 2.2, p. 2.6), Output from the system 
(in this case student outcomes) is seen as a Joint function of: (a) the 
process under consideration, (b) the input to the process, and (c) other 
processes in operation. Differences in student outcomes between the CS and 
UB groups could be attributable to any combination of these three factors, 
either additively or in interaction. To attribute differential output 
exclusively to the process under consideration, it is necessary to have 
equivalence or control of the UB and CS groups in terms of background 
variables and exposure to other processes (programs) that relate to the 
output measures under considerat.lon. 

Clearly, it would be impossible to equate the two groups on all 
dimensions of input and other external process operations; however, attempts 
to equalize the two groups as much as possible on relevant variables is a 
sound analytic technique that should be undertaken. Elimination of some 
relevant dimensions on which the two groups could differ was, in fact, 
accomplished by the design. CS group students were selected from the same 
schools and within the same grade levels as the UB participants (see Chapter 2, 
section IV). This selection procedure built into the study an equivalence 
of the two groups in terms of some major external processes, i.e., regional, 
state, district, and school-specific general educational environment. 
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Further, such a design produced two groups which were of the same general 
age and educational attainment. 

Still, the two populations defined by the UB and CS samples should 
differ on other relevarat variables due to constraints on UB membership. 
Within a given HS, thos^ students selected for UB should differ from nonpar- 
ticipants since the UB participants are academic risks and come from families 
with limited economic means (and thus were selected from a defined subpopu- 
lation of the total HS student body) . It should be recalled that sampling 
of the CS group was carried out in a manner designed to reduce differences 
between the UB and CS samples on tha factors of academic risk and poverty 
status. 

Design, however, cannot always assure group equivalence (in fact, for 
the current study it was not anticipated that such would be the case) and 
equalization after the fact is often required. Such was the case in the 
current study. The technique of statistical adjustment used in this study 
to achieve a posteriori group equalization was a form of balancing (see 
subsection II. B and Appendix F) . 

The subject of this section is an examination of the characteristics 
of the UB and CS groups in order to uncover possible preprocess or extra- 
process differences. Statistical adjustment techniques which were used to 
correct for observed differences will also be discussed. 

A. Differences in Major Background Variables for the Total UB and CS 
Groups 

Recalling that data available for the entire group were limited to a 

subset of variables, it should be clear that analysis of preprocess group 

differences for the total UB and CS groups is restricted to those variables 

12/ 

of the Master File and STF. Table 7.1 shows both the weighted — and 
unweighted distributions of the UB and CS groups on sex, race, age, poverty 
level status, academic risk status, and grade level in the fall of 1973. 



— Based on the best information available at the time, sampling of the 
CS group included oversampling of students who were both poor and academic 
risks (see Chapter 2, subsection IV. A) . 

12/ 

— Weighted percentages were computed using raw sampling weights 
(inversely proportional to probability of selection). 
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Table 7.1 

DE^OGRArHrrilHSSACXEiaSTICS OF THE STUDEST GROUPS 







1 — " 
1 Unweighted 
f Percentages 


W«ighced^^ 
P^rcetcsa^es 


Standss: 


Varl rble 


Response 
Category 


U3 


CS 
Grouu 




CS 
Group 


Error . ^ 
Difference 


Se ^ 


Male 




51. 7Z 


■.^^ 


53. 5Z 


2.7 Z 




Feoale 


5; 3 


47.2 


35. >. 


45.7 


2.7 




■ .0 


1.1 


0. ^ 


0.8 


0.3 




Black 




36.7 


60.? ^ 


27.9 


4.2 




White 




43.8 


17. S 


55.2 


4.6 




Ocher 


v3,7 


14 ,4 


19 . 9 * 


>LX . ^ 


3.2 




IndetersHnat^^ 


1.4 


5,1 


1.3 * 


4,7 


0.8 


Age 


14 or less 


1.0 


1.0 


1.0 


0.8 






15 


6.9 


12.4 




14 .6 


1 




16 


23.0 


25,6 


22..: 


31.0 






17 


35.8 


30.6 


35^ 


28,7 






IS 


25.5 


20.2 


26*1 


17 .7 






19 


5.6 


4.0 


6.0 


2.5 






20 


1.0 


1.0 


1.1 


0.4 






21 or isore 
Mean— 

c/ 

Inde terainate*- 


0.2 


0.3 


0.2 


0.3 










17.0 * 


16.6 


O.057 




1.0 


4.8 


1.0 * 


4.1 


1,0 


Poverty 
Level 


Povercy Laval 
Not Poverty Level 


22.6 


4y .-I 
47.0 


64.5 * 
22.5 * 


34.6 
61.3 


2.6 
3.1 




c/ 

Inde tenainate*- 


13.0 


3.6 


13.0 * 


4.1 




Acadeaic 
Risk 


Risk 

llot Risk 


44.3 
54.9 


52.7 
46.3 


45.3 
54.0 


46.4 
52.7 


2.4 
2.3 




c/ 

Inde term Incte— 


0.3 


0.9 


0.7 


0.8 


0.5 


Grade Level 
(Fall 1973) 


10 
11 


14.6 
37.9 


32.2 
32.7 


14.3 * 
37.3 * 


37.3. 
32.2 


2.4 
1.3 




12 


44.9 


33.7 ' 


45.3 * 


29.1 


2.0 




Indeterminate--^ 


2.6 


1.4 


2.6 


1.4 


0.6 


Number of 














Cases 




3.442 


2,145 


20,906 


1,326,036 





!:orS: Percentages are computed witbin student groups within the particular variabli 
considered and may not total lOO percent due to rounding error. An asterisk 
(*) is used to indicate a statistically significant (P < .05) difference. 



— Weighted percencages are computed using raw sampling weights, and as such are 
population estimates. 

2/ Computed for weighted data. 

c/ 

— Indeterminate response represents either no data or inconsistent data- 

— Reported value is aean or detarminate responses. 
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The weighted distribution's provfTy unbiasea estimates of the UB and CS 

populations. A cx)mpari3o^ :)if ygsg;hted percentages indicates the extent to 

which the natione-l popai^i^ -ionr. a&UB participanrs differs ^'^om the population 

13/ 

ox HS students with wh ?l * gajtCLv school. — Since UB pa^: licipants are 

not selected randomly : :o2in "h:)tjp:2Xi. iation of students in th feeder schools, 
it is not to be ezspectec r^^^c^ jh-3^r ^o groups would have similar profiles in 
terms of the variables prosei-j^ai Table 7.1. As such, the group differences 
reflect the selection proce: are . ^^1^ by UB staff in choosing -participants 
from the "feeder" high sc:n. ^ a unweighted percentages are not estimates 

of populations, but rather XA\kxy ^^iov the distiributions of the selected 
variables for the actual UB participants and conrrrarison students. 

In general, the CS sample . >r* ^ . sanilar to the UB sample znan the CS 
population is to the U3 piu^ .aCc '^m. This, of course, was one of the purposes 
of the sampling plan which i^lact:^.: comparison students "like UB participants" 
with greater likelihood. " "le 3 UB participants selected in the sample 
represent an estimated 20, ^ 5 participants nationally, and the 2,145 
members of the CS sample re . -''^^yiit^nt a national CS population of 1,326,036 
students. 

14/ 

Also shown in Table 7,^ -lare standard errors of differences — for the 
reported weighted proportixrnj? a'i means. If, in fact, no difference exists 
between 'the two groups, then difference which is as large or larger than 
two standard errors would be repeated to occur, by chance sampling variation, 
less than 5 percent, of the rlnr;?, .ach a difference will be considered 
statistically significant. J-i ir^: be seen that the two samples clearly 
represent two different popiTl™ r jtt^ The UB population contains more 
females and fewer white studentH rhan the C3 population. The UB group is 



13/ 

— It is important to realize that the population considered here is not 
all other HS students in coterminous USA. Rather, it is those HS students 
who are not in UB but who are attending the UB "feeder" schools. Due to 
geographic location of projects and. discretion on the part of the project 
as to the schools from which i:i wtTl recruit, it is not reasonable to 
assume that feeder schools are rrmpresentative of all high schools nationally. 
Therefore, it is not "warrantted to aissume tiiat the CS population is repre- 
sentative of all HS students natJjDirally . 

14/ 

— The standard error of differences of two statistics is an index of 
the extent of variability c the difference in those statistics which would 
be expected under the same design over different possible samples. 
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also seen to have a much hi iher concentration of students within the 
poverty level class icicatiion and to be more concentrated in grades 11 
and 12. This latter face probably explains why the UB group tends v: be 
older than the other studiemts attending tne high schools from which trnf^ ' 
are selected. The U3 antid CS populations appear to be quite similar iz^ 
terms of academic risk classification, so that zhe oversampling of CS 
students considered as academic risks tended to inflate the proportio: of 
CS academic risks ia the sample which was drawn. 

To further study possible preprocess differences between the UB snc- Z3 
groups, examination of ndath grade academic information available freer tfce: 
STF was undertaken. The results of the analysis are presented in Table 
7.2. Again, both weighted and unweighted statistics are presented, hxzz 
differences between the two types of computatiozis are quite minor. The 
variables considered in Table 7.2 are those defined in subsection I. A. 
Even in light o£ the slightly higher (but not statistically significant,; 
proportion of indeterminate data in the UB group, the similarity of the two 
groups for these academic measures is quite marked. This strong similarity 
suggests that the two groups do not differ on these preprocess variables 
and that no adjustment involving these variables need be undertaken. 

In summary, it is clear that preprocess diff erences . exist between the 
UB and CS groups and that some form of equalization is necessary prior to 
examination of differences in outcome measures between these groups. The 
procedure used to accomplish this balancing is discussed briefly in the 
following subsection and more fully in Appendix F. 

B. Balancing Procedure 

In cases such as the current one, where moderator variables (pre- 
process variables) are related, to dependent variables (student outcomes) 
and where the distributions of these moderator variables are different for 
the groups under consideratiam (UB and CS) , it is usually sound analytic 
practice to adjust or correct the dependent variables for the influence of 
the moderator variables. There are many techniques available to accomplish 
this adjustment process. Perhaps the most widely used is linear regression, 
in which the linear relation of moderator to dependent variable is removed 
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Table 


7.2 

THE STDDE: 5R0U?iS 


[ Variable^^ 




. L 

Unwerrstred ' Weighted—'^ 
Stati. ti-cs i Statistics 


of 

Di5r:;fcrenc e— 


CS 1 UB CS 
iJronp Group ! "rouo ISrouTJ 


! -Tinth Grade Normalized 
■ .Academic GPA 


Meanr^ 


17.22 10.1% 
5.052 4.949 


5.048 5.094 


'3^% 
D , 049 


^Tiath Grade Proportion 
of Courses That Were 
Acadeiaic 


IndE-enainace^'^ 


14 ar: 3.2% 

0.663 3.646 


0.666 0.653 


2.5% 
0.008 


Ninth Grade Proportion 
of Academic Courses 
Passed 


Ind er ernuna t e— 
Mean^' 


14.7% S.3% 
0.914 0.888 


13-7% 9.2% 
0.912 0.913 


0.009 \ 


Ninth Grade Proporrion 
of Academic Courses 
That Were Advanced 


Indeterminate^^ 
Meatr^^ ' 


14.1% 8.2% 
0.24^ 0.228 


13.2% 9.2% 
0.240 0..256 


L.i^ i 
O.E:6 /: 


Ninth Grade Proportion 
i'lThat Were RemediaL 


Ind ererminata*^^ 


14.1% 8.2% 
0.Q02 0.002 


13.2% 9.2% 
0.002 a. 001 


0 . OEi 


Number of Cases 




3.442 2,145 


20,906 1,326,036 





.NOTE: Statistics a-e computed within studect group (CS or UEj) for the particular variable 
considered. None of the differances reported in this csile are statLsticallv 
significant (P < .05). 

a/ 

See Appendix E for deriaitlons of academic, normalized GPA. advanced, and remedial. 

b/ 

— h'eighted statistics are conputsd rising raw sampling weighcs.. 
c/ 

— Computed for weighted data— 
d/ _ . 

— _ Statistic given is percanr of indatermii=-== responses, consisting of either no data 
or inconsistent data. 

e/ 

— Mean is computed only for xespaEients wtnh setersnfiisie dats. 
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(e.g.. analysis f cov :;-la;nce partiai corr-l^vic::- techniques). A very 
sinJpi.;:; form of cis tewliiu^que is well adapta^d tc. .quantitative data 'ihen one 
is willing to a^jsume t i^it he aajority of cbs it^^^^^^^raror influence is 
liE>ea:r and equ^-'alent i:ir dd,~ereiit subgrouzis.. 7-r is felt, however, that 
the majority of rhe d£r:a iirr rhas study will noa apport any of the neces- 
sary'- 3cs sump t ion- reqi:^-ad icr Linear regressi;in. ijustmen-t procedures. 

^.other aunrcach t:: dan^ adjustment is th- analysis of variance 
model This te-zhniqua. -irr^-d^&d witJiin the r—jne of ge:aeral linear 
mocisl^.. may be used to the "effects' main effects and inter- 

aciiioi:: effects) c i spac:^.^ categorical faaxoEE3 having removed any effect 
at trusted to other cat.^ir:::.c^ factors. Like :t:he linear regression model, 
relatirrely strong assunr^xiioriis about the data niiiitr be Tn:ade (e.g., equality 
of V5r:i.ances over subgr oups • , and this technique is best applied to quanti- 
tative dependent variab:.e da.ce. Ir would be dif.7fxcult to employ an analysis 
of Variance model, since the rcutiber of cases in ^'ome cells of the model 
would be extremely smaH.- Eurtlier, since much cf the UB dependent variable 
data will be proportions, consadaraiile data transformation (i.e., log or 
arc sine transformations) woald required, and reporting such transfomrad 
data often clo.uiis the dsra pizrtara.. It is felt that the data are typically 
not appropriate for this adjustment procedure either. 

Instead, a bals^rnrcg procedure lirhich adjusts the observed data with 
respect to distributiru.,al prcnarties of the nicderator variables was used. 
The adjustment procad~e is specifli^ in di^rcdLl in Appendix F, but will be 
illustrated here by completely h>^oth^t: . . exainple for the interestei. 
reader. Suppose thai- a sitxiation te-aster^i c-. -^hdwn in Table 1.3.— lErcm 
the. table it ca::; be -^^en that there cj^o ^gro^s (A and B) that differ in 
teems of the pcrprcnrtccm. s:itudanr::s fallimg jtnto the levels of poverty 
staitus (80 per-encr cn^ rrrrr?^ in grcpcip A ai^. clasislf led as within the poverty 
levsl, while- only 2C ^sccert of tbrr^ z-i rche umslan:2ed group B are so 
classified). Moreo^Pen. if. is ^eem taat i^i-thin both groups, poverty status 
cla3sificati::2n is rp- 1— n rio average CSi (lower grade point averages are 
assiDciated Kith poverry J^si^l cla^f iiiarion) . Hore importantly, it can be 



15/ 

The proDlem pos-d ir. the example given may J?9 recognized by some readers 
as equivalent to the nonrrrthoganaliry problem in, analysis of variance. 
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Table 7.3 

-r:XAMPLE OF BALANCING TECHNIQUE USm: liYrOTHETICAL DATA 
RELAiniG TO GRADE POINT AVERAGE AED PC\^TY STATUS 



Poverty Status > 
Classifacatioa • 


Gr'-up dassriicatian 


Group A 


G.rou:p B 
rjna^ c ed. 


Group 3 
Balancsed 


Proportlori Average 
of Studencs GPA 


Fi'-iDpcr'^i^n Average 
oc Studsnts GPA 


5r opxDr t ion Average 
oif Students GPA 


Poverty I^val 
Not Poveirty Level 


.80 2.0 
.20 3.0 


.ir. 1.5 

.80 2.5 


.SO 1.5 
.20 2.5 


Total Gxcup— 


1.00 2.2 


1.^ 2.3 


1.00 1.7 



NOTE: Thase data are punreJLy hypotheticaL am: .£±o not ^eflacl: t:he 

true d i s tir ibu tl on s for any group am potPsrty status err on any measure 
of GPA used in this scudy, 

a/ 

— The average GPA for the total grcnp is obrained as weighted sum of the 
subgroup means within that group. For example;., the total group A average QPA 
is determined as (.80) (2.0) -r (.20) (3 .G) =2.2. 
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seen that within either level of poverty status classlfica-:ioii, group A has 
a higher (by .5) average GPA than group B. 

To this point, all indications frcsa the hypothetical iats in Table 7.3 
would indicate that those in group A were obtaining betrer stashes than 
those in group B, regardless of poverty status . Some confusiL-m arises, 
however, when comparing the total group means for group A a:M -he unbalanced 
group B- The total group mean is obtained as a weighted av-jErsge of the 
subgroup (poverty level classification) means within that grroc?. The group 
A average GFA is given fay (.80) (2.0) -r (.20)(S..O,) = 2.2,; wkil* for the 
unbalanced group B it is (.20) (1.5) + (.80) = 2.3. The i^ults of 

this averaging may be distressing to some reaaerrs since it incL^ates that 
group B has, on the average, a higher grade ycint a-verage th.an_ group A; 
however, this is a statistical fact. Even rixmish the subgroup means stand 
in an order clearly favoring group A, the tocal graup meians are juxtaposed. 
The apparent anomaly has been brought abour due to the diifsr«isni=l distri- 
bution of the two groups in resp=ect to poverty status couple -siith the fact 
that poverty status itself is relaited to GPA. 

If the anaay?tic question to be answered is caacem'ec: Gnly worii gnDira 
irrespecti T^e of any difference which Eg-.; sx±s- benrsss^ ^gtmigs en ^ 
distribution of tae moderating variaJjl^ . then thee ansswer is cisarly that 
group B has a higher grade point average than grtPc? A. Zf , ^ the other 
hand, the analytic question is cantsrned with dJ ^frax^nces betcsa^n the twe 
8^°"PS free of the effect of diffetential nrover- : st^atus:. tssar it is equally 
clear that a comparison of the uncorrected gronr lusans c^sccths the tme 
situation. The balancing technique used in the .^lyses repartsi In this 
chapter would resolve the incongruity by creating an artificial group B 
population wlEich Is comparable to gtoup A in tersns of the poverty status 
distribution (i.e., a group B in which 80 peascartc of the asenmers were 
classified as poverty level). This is the ^it=us:-:,=m ssrown f-r -a balanc-^i 
group B in Taile 7.3. Comparing the total. ;^viiap ^rmesm fzn: C2.2) to 

the balanced group B mean (1.7) reflects th£ -act that grcorr 3. -nembars 
within any poverty classification have an average GPA ^hich: is greater by 
.5 than that for nooparticipants. In other woirds , whnn arfjnstr.»aent is mad.-, 
for differential distribution of the moderator variable wi-thin =he two 
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groups, the effect of that moderator variable is balanced across the two 
groups. 

The actual balancing technique used in analysis involved more than two 
balancing careg::3rles, but the example given shows the general manner in 
which the balancing was performed. The technique statistically equates the 
joint distribution of possible moderator variables within the two groups 
(i.e., it forces the proportion of poor, academic risk, black, female, 
twelfth grade students in the CS group to be identical to the analogous 
proportion in the UB group, etc.). This technique makes fewer assumptions 
about data quality than either the analysis of variance or regression 
techniques and allows somewhat greater flexibility in the choice of data 
elements to be adjusted. Obviously, this method can be applied for one . 
two, or more moderator variables, either jointly or singly, provided cell 
frequencies sxe of sufficient size to provide stable estimates of all 
proportions and n^ans. 

As a resTj.lt if previous examinations of group differences, the follow- 
ing moderator varriables were used in balancing (adjustment): sex, race, 
grade levei, poverty status, and academic risk status. Since many of the 
critical a^ialyses: were conducted within grade level, the first set of 

adjustments ^as (Lone within the three grade levels considered. Within each 

16/ 

grade level, 16 balancing categories were formed. — ' A description of the 
balancing caregor:ies and the distribution by grade of the UB and CS groups 
over these categories is given in Table 7.4. After adjustments had been 
made within grade, further adjustments over grade level were carried out 
for aggregate comparisons. 



C. Other Uncontrolled Sources of Group Differences 

Although the balancing procedures described above introduced the 
desired statistical control for those variables used in the balancing, it 
was not expected that this would eliminate all group differences related to 
other relevant variables (differences in, input and/or exposure to other 
relevant processes). Some insight into the extent to which the two groups 

16/ ' 

— The balancing categories were formed uy a complete or partial crossing 
of the variables sex, race, poverty status, and academic risk status. 
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Table 7. A 



PERCENTAGE OF STUDENT GROUPS IN BALANCDJG CATEGORIES 
BY HIGH SCHOOL GRADE LEVEL IN FALL 73 



c/ 


rail 73 Grade Level-^ 




10 


11 


12 


Unveiszhtcd 


v^eightea— 


Unweighted 


WeiKhted^'^ 


Unweiehted 


Weichted'^'^ 


UB 




TTQ 

US 




UB 


CS 


UB 


CS 


UB 


CS 


UB 


CS 


I. Poverty Level » Acadc?iic 


























«wx9K.« sxBcK. rule 


S.8Z 


7.2% 


8.4:: 


5.1Z 


9.1Z 


8.9% 


8.6% 


5.7% 


10.0% 


7.3% 


9.5% 


4.3% 


Z' Jcverty Level, Nonrisk, 




























7.9 


3.1 


7-6 


1.7 


7.9 


4.7 


7.1 


2.9 


8.5 


2.5 


7.7 


1.4 


3- Konpovercy, Acadealc 


























Ri^lC '^Jiirlf Vfal0 


S.Z 


3.7 


5.4 


•i.l 


5.8 


4.9 


5.8 


3.9 


4.9 


2.7 


4.7 


2.8 


4- Soxipovercy, Nonrisk, 


























Rldr k Ma 1 a 


6.7 


3.4 


6.5 


2.8 


3.5 


2.0 


3.3 


1.9 


4.4 


2.2 


3.9 


3.5 


5. ?overcy Level, Non- 


























^ xsraw, AXa&x r t?wa ^e 


7.9 


9.8 


8.0 


6.3 


10.1 


7.6 


9.7 


A. 9 


9.8 


10.7 


9.6 


5.3 


6. Poverty Levels Ncn- 




























13.^ 


A. 2 


13.9 


3.7 


14.8 


5.5 


14.9 


3.6 


15.1 


5.9 


14.8 


3.6 


7. Konpo\.'ercy . Acadesic 


























P'iaV- "Rlar-V TTatn^l A 


5.6 


3.5 


5.4 


3.7 


4.0 


2.0 


3.8 


2.3 


4.1 


2.7 


3.9 


2.9 


fi. Hoapovercy, Ncnrist, 


























Ill.jt.cV T^pnui ^ a 


10.0 


2.8 


10. 0 




O- 0 




0. U 


3.5 


7.2 


3.3 


6.9 


3.4 


9. Poverty Level, Acadaolc 


























Risk. Unite 


3.6 


7.6 


3.9 


4.2 


4.1 


5.4 


4.7 


4.8 


4.0 


6.3 


4.5 


4.5 


iO. Poverty Level, Kon- 


























risk. White 


A. 2 


6.5 


4.1 


7.0 


6.8 


6.5 


7.3 


5.6 


6.8 


7.7 


7.3 


6.3 


IZ. Nonpoverty, Academic 


























Kisk, White 


3.1 


11. 0 


3.4 


14.8 


2.6 


12.9 


2.9 


16.4 


2.4 


13.4 


2.6 


18.1 


12r Kcnpoverty, Nonrisk, 




























2-1 


18.3 


2.3 


27.6 


4.3 


16,7 


4.3 


25.9 


3.6 


19.2 


3.8 


31.1 


15. Poverty Level, Academic 


























iUsk, Other 


4. A 


.6.7 


5.2 


4.5 


5.8 


7-2 


6.5 


5.4 


5,3 


4.4 


5.9 


2.3 


lA. Poverty Level, Monrislc, 


























Other 


8.1 


A. 5 


6.8 


4.2 


7.0 


4.4 


7.2 


3.2 


6.0 


3.7 


6.3 


2.3 


15. Wonpoverty, Academic 


























risk. Other 


4 0 


A.l 


4.9 


4.5 


4.1 


3.5 


4.5 


3.4 


3.4 


A. 7 


3.8 


4.7 


16. Kcnpoverty, Nonrisk» 


























Ocher 


5.0 


3.A 


4.4 


3.2 


3.5 


5.4 


3.3 


6.5 


4.5 


3.6 


4.8 


3.3 *. 


Nuicljer of Cases j 
r —^.-^ ■ ■ ■ ■ , , : J 


521 


706 


3,113 


506,889 


1*329 


708 


8,036 


429,126 


1,592 


731 


9,757 


390,020 



1 Q^wuj' V'**' w* ^^'z wi-wiiAi* ,-si.«iiac xevex duu loav not aoa Lo xuu [jci. i-tsnw aue 

to rounding error. 

a/ 

- For fall 73 grade level classification, the most reliable grade level was used even if it was inconsistent 
with other indications of grade level. 

b/ 

- iTelghted percentages are computed using rav sampling weights, 
c/ 

- For purposes of establishing categories, indeteminate poverftv status is combined with nonnovertv, indeterminate 
academic risk status is combined with nonrisk, indeterminate sex is combined with female, and indeterminate race 

is combined with *'other." 
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still differed on relevant preprocess and extraprocess variables was 
desirable, and other analyses ware undertaken. These analyses were con- 
ducted after balancing had been performed, and, as such, the results 
reflect additional differences between the UB and CS group after correction 
for sex, race, poverty status, academic risk status, and grade level (in 
other words, residual differences). 

1. Preprocess (Input) Differences 

In Subsection II. A, differences between the two groups, before 
bal^cing, on five ninth grade academic measures were examined. 
Although observed differences were extremely small, the possibility 
existed that the differences would be larger after balancing. A 
subsequent examination of these variables revealed that this was not 
the case; in fact, the differences had become slightly smaller. The 
results of this analysis were so similar to those prior to balancing 
that they are not reported here. 

Other comparisons of extraprocess differences between the total 
UB and CS groups were not possible using the subset of variables 
available in the Master File; however, a considerable number of pre- 
process measures were available for BSQ respondents. It should be 
recalled from Chapter 3, Section VI, that the BSQ respondent group, 
while constituting a large proportion of the total sample, was not 
representative of the total UB or CS populations. However, the bias 
introduced into this respondent group was hypothesized to cancel when 
comparisons between CS and UB groups were made. To the extent that 
such an hypothesis is true, examination .of differences in BSQ respondent 
data will generalize to total UB find CS group differences. 

Table 7.5 presents a comparison of UB and CS responses to item 11 
of the BSQ, which requested information concerning the respondents' 
current (spring 1974) area of residence. The comparison was made 
after adjustment of the data by the balancing technique and further 
adjustment for instrument nonresponse. Also presented in Table 7.5 
are the standard errors for the group differences for the percentages 
given. The places of residence of the two groups are strikingly 
similar, which is not too surprising given the sampling technique 

7.20 



Table 7.5 



PERCENTAGES OF UPWARD BOUND PARIIXIPAIHIS AND COMPARISON 
STUDENTS LIVING IN SPECHIC HDCATIONS 



Location 


! 


f Group 
J U3 CS 


, f 

Standard 
Error of 

u ^ c £^ cn c e 


Model Cities Area 


a/ 

Inc et erminat 
Lirrlng in LocaizLon 


29 ^Sr: 29.9% 
19.. 3 22. A 


w 

2 ft 


Urban Renewal Area 


Incie t erminat er- 
Lilting in Locaitaoir 


f 

j 37.5 37.5 
11.. 3 10.4 


y 

y 


Federal Housing 
Project 


a/ 

Indeterminate-- 
Lining in LocaticEH 


29.7 28.0 
15.0 16.3 


2.4 
3.1 


Indian Reservation 


a/ 

Indeterminate— 
Liwdjig in Locataiaa. 


31. 4 31.3 ' 
^..4 * 0.5 


y 

1.3 


Farm 


Iitdeterminate^" , 

Livfng Tn t.nr^rrr-f'fTTTn 1 


3Q.6 23.1 
ia.5 * 7.4 


3.1 
1.2 


Sample Size 


Unweighted 
Weighted 


2,6110 1,611 
18, mi 1,171,641 , 





NOTE: Reported percentages were cicmpaimed usxjig weighted data, after 
balancing and adjusting for i,n!=rrrument nonresponse, for that 
subset of students eligible:: lox ESQ adiministratioH. Data 
presented ±ii this table wera obrH^ned £rom responses to item 11 
of the esq;.. An asterisk fjs used to indicate a statistically 
significacx (P < .05) drfferance^ 

a/ - - 

^ Indeterminats response repxesemrs ±tem nonresponse, multiple response, 
and inconsistent response* 

Standard errors were not coHiputr?d for absolute differences less 
than 1 percent • 
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used. It can be seen from Table 7.5 that statistically significant 
differences exist only for the locations of ''Farm** and "Indian Reser- 
vation," with greater proportions of the UB group residing in these 
areas. To some extent these findings may be attributable to the 
definition of feeder schools (see Chapter 2, Section IV) and to the 
fact that no BIA reservation ..schools were selected. It may be, however, 
that there are proportionally greater numbers of the UB population 
living in these areas, even after balancing. 

These comparisons are somewhat attenuated by large proportions of 
indeterminate responses (approximately 30 percent in most cases) . 
Since, however, the proportions of indeterminate responses are quite 
similar for the UB and CS group, it is relatively safe to assume that 
any nonresponse bias is similar for the two groups. If this is the 
case, then the comparisons are, in fact, valid. If this is not the 
case, then the differential allocation of the indeterminate responses 
could create statistically significant differences where none are 
present in Table 7.5 (or no difference, where statistically signifi- 
cant ones now exist). All things considered, however, the results in 
Table 7.5 suggest that the two groups do, in fact, differ in terms of 
proportions living in rural areas and on Indian reservations (implying 
also that the groups may differ in terms of proportion of Native 
Americans) . 

Table 7.6 presents the distribution of highest educational 
attainment of parents in the UB and CS groups (item 17 of the BSQ) . 
Due to the marked similarity between the groups of the distributions 
of parental education for both mother and father, no standard errors 
were computed. Although indeterminate data account for upward of 15 
percent of the responses in some cases, it "is quite reasonable to 
assume from the available results that there are no substantive differ- 
ences between the two groups in terms of the educational levels of 
their parents. 

Table 7.7 shows the distribution of parents' occupations for the 
UB and CS groups (item 18 of the BSQ). The distribution of mothers' 
occupations is strikingly similar for the two groups and standard 
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Table 7.6 



EDUCATIONAL ATTAINMENT OF PARENTS OF UB 
PARTICIPANTS AND COMPARISON STUDENTS 











Father 


Mother 


Level of Educational Attainment 


UB 


CS 


UB 


CS 












a/ 

Indeterminate- 


15.7% 


15.3% 


6.2% 


10.7 


Some grade school or less 


13.7 


, 11.8 


8.0 


7.5 


Finished grade school 


9.8 


8.4 


9.5 


8.9 


Did not complete high school 


26.6 


26.5 


29.6 


32.2 


Finished high school or 
equivalent 




. o 


9Q 1 




Some business, vocational, 
technical, or trade school 


3.1 


2.6 


3.1 


2.2 


Finished business, vocational, 
Lccnnxcax , or uracie scnoox 


2.1 


2.8 


3.6 


•3.5 


Some college (including two- 
year degree) 


4.1 


3.6 


6.7 


4.9 


Finished college (four- or five- 
year degree) 


2.6 


4.9 


2.5 


3.4 


Attended graduate or profes- 
sional school but did not 
receive degree 


0.3 


0.6 


0.8 


0.6 


Obtained graduate or profes- 
sional degree 


0.8 


1.6 


0.9 


1.8 













NOTE: Reported percentages were computed using weighted data, after 
balancing and adjustment for instrument nonrespohse, for that 
subset of students eligible for ESQ administration. Data 
presented in this table were obtained from responses to item 17 
of the ESQ. Sample sizes are the same as that reporteci in 
Table 7.5. Standard errors were not computed due to the marked 
similarity of the distributions. 

a/ 

Indeterminate response represents item nonresponse, multiple response, 
and inconsistent responses. 
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Table 7.7 



OCCUPATIONAL LEVEL OF PARENTS OF UB PARTICIPANTS 
AND COMPARISON STUDENTS 



Parents' Occupational Level 


Father 


Mother^'' 


UB 




CS 


Standard 
Error of - 
Difference 


UB 


CS 


Indeterminate^^ 


22.1% 


18.4% 


2.9 


18.6% 


19.9% 


Laborer or Service Worker 


51.1 


ft 


44.9 


2.1 


26.4 


23.6 


Craftsman or Foreman 


14.9 


ft 


18.5 


1.7 


1.8 


1.7 


Office or Sales 


3.8 


* 


6.6 


1.1 


8.6 


9.1 


Manager or Ovmer 


3.5 


* 


6.7 


1.3 


1.9 


1.9 


Professional or Technical 


4.1 




4.7 


c/ 


8.3 


10.6 


Homemaker or Housewife 


0.5 




0.2 


c/ 


34.5 


33.2 



NOTE: Reported percentages were computed using weighted data, after 
balancing and adjusting for instrument nonresponse, for that 
subset of students eligible for BSO administration. Data pre- 
sented in this table were obtained from responses to item 18 
of the BSQ. Sample sizes are the same as those reported in 
Table 7.5. An asterisk (*) is used to indicate a statistically 
significant (P < .05) difference. 

a/ 

— . Due to the marked similarity of the distribution of responses 
between the UB and CS groups, standard errors of difference were not 
computed . 

Indeterminate response represents item nonresponse, multiple response 
and inconsistent responses. 

c/ 

— Standard errors were not computed for absolute differences of less 
than 1 percent. 
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errors* were therefore not computed. For fathers' occupations, however, 
statistically significant differences between the groups were observed. 
The occupational level of the fathers of the UB group shows greater 
concentration in the Laborer or Service Worker area than that for 
fathers of the CS group and, conversely, less concentration in the 
fathers of Craftsman, Foreman, Office Worker, Salesperson, Manager, or 
Owner. This basic pattern indicates a lower occupational level for 
the fathers of the UB group, which is probably indicative of lower 
socioeconomic status. 

In terms of the preprocess measures that have been examined, it 
is clear that all input differences between the UB and CS groups have 
not been resolved by balancing. The UB group has a statistically 
significant greater representation of rural students and students 
living on Indian Reservations. There is also an indication that even 
though the two groups were balanced on the crude index of poverty 
status, differences still exist in socioeconomic status (as reflected 
in the lojw^er level of fathers' occupation in the UB group). ' 

'The practical significance of these differences is yet another 
matter. Though socioeconomic status and location of residence are 
theoretically related to academic achievement and attitudinal measures, 
identified empirical relationships have not been extremely large. 
Coupled with the small absolute differences between the two groups on 
these variables, the impact of such differences in the output measures 
to be considered should be minimal* .The basic caution addressed to 
the reader, by these relatively small but statistically significant 
differences in preprocess measures between the UB and CS group, is 
that small differences in output measures should be interpreted with 
care, since they may be attributable to input differences rather than 
process operation. Theoretically, the net effect of the input differ- 
ences discovered should result in a bias which operates in favor of 
the CS group. In other words, the CS group should show higher levels 
for the academic achievement measures simply because of input differ- 
ences, all other factors being equal. 
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2. Extraprocess (Other External Process) Differences 

No data regarding the operation of other external processes were 
available for the entire sample; however, such information was avail- 
able for the subset of BSQ respondents. These data were analyzed and 
the results presented below are subject to the same considerations in 
interpretation as noted in the previous subsection. 

Table 7.8 presents information pertaining to HS course of study 
and participation in intervention programs, other than UB, for the CS 
and UB respondents to the BSQ. Small but statistically significant 
differences exist between the two groups in terms of pre-process 
courses of study. UB participants report greater participation in an 
academic-related course of study and less in a vocational/business 
course of study. This finding is somewhat confounded by the difference 
between the groups in percentage of indeterminate data. Differential 
within-group distribution of the indeterminate data among the other 
response categories could, theoretically, reduce (or, even reverse the 
direction of) the observed differences. 

Participation in Talent Search (TS) , another of the TRIO Programs., 
is quite limited for both groups, and group differences in such parti- 
cipation is not statistically significant. Considering other inter- 
vention programs^^ (exclusive of TS and UB) , over half of the members 
in each group report no participation. Although differences in per- 
centage participation are small for the categories reported in Table 

18/ 

7.8, the average number — of other programs in which UB students have 
participated is significantly (over three standard errors) greater 
than that for the CS group; however, the absolute difference is quite 
small and the practical significance of this difference is questionable. 



— These programs, listed in item 24 of the BSQ (Appendix D) , include 
College Readiness, College Bound, Aspira, Educational Opportunity Program, 
Cooperative Vocational Education Program, Neighborhood Youth Corps, and 
others. 

18 / 

— Mean number of programs in which students had participated was computed 
for determinate responses only, without adjustment for item nonresponse. 
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Table 7.8 



PREVIOUS HIGH SCHOOL COURSE OF STUDY AND PARTICIPATION IN 
INTERVENTION PROGRAMS FOR UB PARTICIPANTS AND COMPARISON STUDENTS 





ivesponscs 


Group 


Standard 
Exxox 




Ninth Grade Course 
of Study 


a/ 

Ind e t ermina t e— 

General 

Academic 

Vocational/Business 


10.7% * 15.3% 
46.5 42.2 
32.8 * 25.3 
10.0 * 17.2 


2.1% ■ 
2.9 
3.1 
1.7 


Previous Participation, 
in Talent Search (TS)— 


a/ 

Ind e t etmina t er- 
No Participation 
PaT ticioation 


4.5 6.0 
90.5 90.1 
5.1 3.9 


1.1 

£/ 
1.2 


Number of Other Inter- 
vention Programs (Ex-- 
elusive of UB and XS)^, 
in Which Participated— 


a/ 

Ind e t emninat er- 
0 
1 
2 
3 

4 or aore 
Mean— 




4.5 6.0 

51.4 55.2 
26.6 24.7 
9.0 6.8 

3.7 4.6 

4.8 2.8 
0.867 * 0.720 


1.1 
.04 

1 



NOTE: Reported percentages were computed using weighted data, after 
balancing and adjusting for instrument nonresponse, for that 
subset of students eligible for BSQ administration. Data pre-' 
sented in this table were obtained from items 20 and 24 of BSQ. 
Sample sizes are the same as those reported in Table 7.5. An 
asterisk (*) is used to indicate statistically significant 
(P < .05) differences. 

a/ 

— Indeterminate response represents item nonresponse, multiple response, 
and inconsistent responses . 

For these variables, additional balancing over grade was performed. 

c/ 

— Standard errors were not computed for differences of less than 1 percent, 
d/ 

— Means computed for determinate responses only. 
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The functions of the various other programs in whic±. students 
participated are so diverse as to make a simple count of the number of 
such programs a relatively weak measure of difference in extraprocess 
variables. A more meaningful measure, related to the services received 
from such other programs, is available from responses to item 25 of 
the BSQ. The services listed in that item coulc be meaningfully 
grouped into one of four categories: (a) academic^related (tutoring, 
class work); (b) counseling; (c) vocational training; and (d) financial 
assistance. Percentages of the UB and CS group receiving such services 
are given in Table 7.9. There are no significant differences in the 
relative frequency of receipt of these external services by the two 
groups. 

In summary, there are few statistically significant differences 
and no practically significant -differences between the two gnoups in 
terms of :nthez: intervention prc^ams. Small but s tat isitlc ally signifi- 
cant dif^rences exist in terms of preprocess course of school study. 
The direciJ-on .of these dif f erenires suggests that UB students (with 
greater early participation in an academic-oriented curriculum) may 
have a higxrer preprocess motivation for continuing education. 

Two of the major external processes which may operate. on the 
student (namely the family and community atmosphere) were not treated 
in this study. Such differences would be reflected, however, in 
analyses presented in the previous subsection (i.e., type of community, 
parents* education, etc.). 
3. Analysis Implications 

While differences between the UB and CS groups in terms of vari- 
ables common to all sampled students (Master File data) were statis- 
tically adjusted by the process of balancing (and as such should not 
represent a source of bias in soiDsequent analyses), other preprocess 
and extraprocess group differenires were uncovered for the subsets of 
BSQ respondents. These differences were, in general, quite minor and 
should not therefore introduce any substantial amount of bias in the 
analyses reported below in this chapter. 

There are, undoubtedly, other extraprocess variables on which 
these two groups differ. Since there are no measures of these 
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Table 7.9 



PERCENTAGES OF UPWARD BOUND PARTICIPANTS AND COMPARISON 
STUDENTS RECEIVING SPECIFIC SERVICES FROM INTERVENTION 
PROGRAMS OTHER THAN UPWARD BOUND 



a/ 

Type of Service- 


Group 


Standard 
Error of 
Difference 


UB 


cs 


Ac ad emic -related—'' 


18.0% 


15.0% 


1.8% 


Counseling^'' 


21.6 


18.9 


2.1 


Vocational Training^^ 


14.0 


12.7 


1.9 


e^ 

Financial Assistance- 


9.4 


10.8 


1.4 


Indeterminate—'' 


5.6 


7.9 


1.3 



NOTE: Reported pemenrages were computeeL using weighted data, after 

balaiicing ami adjusting for instmment nonresponse, for that 
subsa^t of students eligible for BSQ administration. Sample 
sizes are tha same as that reported in Table 7. 5* None of the 
differences xepijrted in this table are statistically significant 
• (P < .05) • 

a/ n . . 

^ Receipt of one type of service does not preclude receipt of some 
other type. 

b/ 

— Determined from response to items 25.1 and 25.2 of BSQ. 
c/ 

— Determined from response to items 25.3, 25.7, and 25.8 of BSQ. 
d/ 

— Determined from response to item 25.6 of BSQ. 

Determined from response to item 25.5 of BSQ. 
f/ , ^ 

— Indeterminate response is the same for all categories of services 
and represents complete nonresponse to all subitems of item 25 of BSQ. 
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variables, the nature of such differences and their possible influence 
on analysis results is a matter of speculation. In general, the two 
groups appear to be quite comparable after balancing is applied, and 
differences in outcome measures should be related primarily to UB 
participation rather than to the other factors which have been con- 
sidered in this subsection • 

III. DIFFERENCES IN .EDUCATIONAL CONTINUANCE 
BETWEEN UB AND CS GROUPS 

Two of the major objectives of the UB program (see Section I of this 
chapter) involve educational continuance, namely: (a) continuance in and 
completion of HS, and (b) PSE entry. The extent to which the program meets 
these objectives is the subject of this section. This evaluation was 
relatively straightforward, involving only measures that are extremely 
objective. 

A. High School Continuance/Completion Within School Year 

HS educational continuance with the 1973-74 school year was easily 
determined, as indicated in Section .1 of this chapter. Recalling that 
retrospective data regarding spring 1974 enrollment status were obtained in 
fall 1974 from students who haid not responded to the spring 1974 question- 
naire administrations, the results presented in this subsection should be 
relatively free of possible biases ia the spring 1974 respondent group (see 
Chapter 3, Section VI). 

Table 7.10 presents, within school year, HS continuance/completion 
rates for the UB and CS groups by grade level. In addition to presenting 
the total grade level rate for the UB group. Table 7.10 also provides 
continuance/completion rates within grade level by length of time in the UB 
program. There were, of course, some cases for which continuance/ 
completion could not be determined (indeterminate responses). Three con- 
tinuance/completion rates were therefore computed and are reported in 

Table 7.10. These three rates are: (1) maximum rate (P ), computed bv 

max ^ ^ 

assuming that all indeterminate responses would have indicated continuance; 
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Table 7,10 



FALL 73 TO SPRING 74 HIGH SCHQOL CONTIOTASCE/ COMPLETION a^EES 
BY GRADE FOR UPWARD BOUND PAEIICIPANTS AND COMPARISON GSOE? 




:<0T£: Values reported are based on weighted data, using balanced CS weights, 
and adjusting all weights for cases with indeterminate classification' 
as to grade level or length of time in UB. An asterisk (*) is used to 
indicate a statistically significant (P < .05) difference. 

a/ . 

- Standard errors presenced are computed for the difference in rates between 
the total group of UB participants within a particular grade level and the 
analogous comparison group. 



Computed by assuming all indeterminate continuation cases as conciniiine or 
completed. 



ERIC 



COD 

Computed by assuming all indeterminate continuation cases as not continuing- 
or completing. ° 

d/ 

— Unweighted cell si2e is computing P and P 

max min 

e/ 

— Computed by adjusting weights for indeterminate continuation/completion 
cases. 

— Unweighted cell size in computing P , . . 
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(2) minimum rate (P^j^^j^) > computed by assuming that all indeterminate 

responses would have indicated noncontinuance; and (3) an adjusted rate 

19 / 

(P J.), computed by adjusting for "item" nonresponse. — The values of 
adj 

^adj best available single estimate of the continuance/completion 

rates, while P and P , define upper and lower limits, respectively, of 
' max min . 

this estimate for these groups of respondents. 

Regardless of the rate considered, within-year continuance/completion 
rate is quite high for all subgroups considered. For all grade levels the 
overall UB continuance/completion rate is higher than the CS rate; and for 
grade 12, the rate within the UB group increases with length of time in 
program. 

Nine distinct subgroups are defined by the data presented in Table 
7.10. Maintaining comparisons within grade level, only six independent 
comparisons of continuance/completion rates among these nine groups are 
possible. The a pri^orl comparisons decided upon were: (1) total of UB 
twelfth graders compared with CS twelfth graders, (2) total of UB eleventh 
graders compared with CS eleventh graders, (3) UB tenth graders compared 
with CS tenth graders, (4) UB twelfth graders who joined the program in 
grade 11 or earlier compared with UB twelfth graders joining the program in 
grade 12, (5) UB twelfth graders who joined the program in grade 10 or^-;--^' 
earlier compared with UB twelfth graders joining the program in grade 11, 
and (6) UB eleventh graders who joined the program in grade 10 or earlier 
compare'H with UB eleventh graders joining the program in grade 11. The 
first three listed comparisons examine differences between the total UB and 
the CS group within a particular grade, while the remaining comparisons 
examine differences within the UB group and a particular grade level as a 
function of length of participation. 

The standard errors presented in Table 7.10 relate to the differences 
between the total UB group and the CS group for a given grade level. The 
greater within-year continuance/completion rate experienced by UB participants 



19/ 

— The adjustment was accomplished by distributing the weights of stu- 
dents with indeterminate responses to those students who were similar (in 
the same balancing category, same project"or school — and same grade). 
See Appendix F for a more detailed description of weight adjustments. 
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is statistically significant for grades 10 and 11, but not for grade 12. 
Standard errors for the comparisons within the UB group are presented in 
Table 7 .11. From Table 7.11, it can be seen that only one such comparison 
yields a statistically significant difference. UB participants who join 
the program in grade 12 have lower continuance/ completion rates than those 
who joined the program during the eleventh grade or earlier, 

5» High School Continuance/Completion Across School Year 

Within school year continuance does not, of course, insure that the 

student will return for the following academic year, since dropout can 

occur during the summer vacation between academic years. Summer dropout 

can also occur for those students who continued in school during their 

senior year but who failed to graduate. For this reason, additional 

examination of continuance/completion rates from one school year to the 

next was undertaken. These analyses required differential adjustment for 

nonresponse due to the subsampling conducted during the fall 1974 data 

20/ 

collection period. — ' 

Full year (fall to fall) continuance/completion rates for the UB and 

CS groups, by grade and by length of exposure to the UB program, are given 

in Table 7.12. The pattern of fall to fall continuance/completion is 

considerably different from that for fall to spring; fall year continuance/ 

completion rates are lower, as would be expected. For the CS group there 

is a considerably larger range of P and P . within grade level than for 

ma x mxn 

the UB group. The range of P^^ and P^^^ for the CS group fall to fall 
continuance is also noticeably greater than the analogous range observed 
when considering fall to spring continuance. This is a reflection of a 
higher proportion of indeterminate responses for the CS group for the full 
year continuance measure. 

Standard errors reported in Table 7.12 are related to the differences 
in rates for the total UB and CS groups for specified grade levels. As can 



20/ . / 
— Since previous, nonrespondents (with considerably higher dropout 

rates) were followed up with certainty and previous respondents were 

subsampled for followup, adjustment for indeterminate response without 

regard to previous response status would have spuriously deflated the 

continuance rates. See Appendix F for details of weight adjustments. 
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Table 7.11 



DIFFERENCES IN FALL 1973 TO SPRING 1974 HIGH SCHOOL 
CONTINUANCE/COMPLETION RATES BY GRADE FOR UB PARTICIPANTS 
AS A FUNCTION OF LENGTH OF PARTICIPATION 



UB Student Groi 


ips Comp^ared 




a/ 

Dif f erencer- 


Standard 
Error 


Twelfth graders 
joining program in 
grade 11 or earlier 


Twelfth graders 
joining program 
in grade 12 


p y 

max 

p .y 

min 
ad J 


2.8% * 
3.9 * 
2.8 * 


1.2% 

1.4 

1.2 


Twelfth graders 
joining program in 
grade 10 or earlier 


Twelfth graders 
joining program 
in grade 11 


■ ■ ■■ 

p y 

max 

p . 

mxn 
ad J 


0.0 
0.4 
0.1 


1.3 
1.0 


Eleventh graders 
joining program in 
grade 10 or earlier 


Eleventh graders 
joining program 
in grade 11 


p y 

max 

P . y 

mxn 
ad J 


-0.6 
0.6 
-0.6 


1.2 

1..5 
1.2 













NOTE: Values reported are based on weighted data adjusted for cases 

with indeterminate classification as to grade level or length 
of time in UB. An asterisk (*) is used to indicate a statis- 
tically significant (P < .05) difference- 



— Difference reported is determined by subtracting rate of second group 
listed from rate of first group listed. As such, a positive difference 
reflects a higher continuance/completion rate for the first group listed 
and a negative difference reflects a lower rate for the first group listed. 

Computed by assuming all indeterminate continuation cases as continuing 
or completed. 

c/ 

— Computed by assuming all indeterminate continuation cases as not 
continuing or completing. 

— ^ Computed by adjusting weights for indeterminate continuation/completion 
cases. 
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Table 7.12 



FALL 73 TO FALL 74 HIGH SCHOOL CONTINUANCE/COMPLETION BATES BY 
GRADE FOR UPWARD BOUND PARTICIPANTS AND COMPARISON GROUP 







Student Grouo 








UB in 
Program at 
Grade 10 


UB Joining 
Program in 
Grade 11 


UB Joining 
Program in 
Grade 12 


UB Total 
Group 


CS 


Standard 
Error— 




P ^' 
max 


88.8% 


89.4% 


89.4% 


89.3% 


91.1% 


2.2% 




c/ 

min 


86.2% 


87.4% 


85.4% 


86.4% 


.81.6% 


3.1 


12 


d/ 


216 


411 


436 


1063 


549 


— 




adj 


88.5% 


89.0% 


88.9% 


88.8% 


90.1% 


2.5 






214 


405 


421 


1040 


496 






P ^/ 
max 


91.1% 


91.7% 




91.6% 


92.4% 


2.2 




c/ 

min 


83.5% 


85.8% 

« 




85.3% 


80.5% 


2.5 


11 




228 


738 




966 


557 


— 




"adj 


90.7% 


91.4% 




91.3% 


91.3% 


2.3 






210 


691 




901 


472 


— 




P — 
max 


•D/a 






93 . 5% 


86. 6% 


3.4 




p 


89.5% 






* 39.5% 


79.1% 




10 


si/ 


413 






413 


571 






adj 


93.4% 






* 93.4% 


85.5% 


3.7 


1 




392 






392 


522 





NOTE: Values reported are based on weighted data, using balanced CS weights, 
corrected for fall 1974 subsampling and adjusted for cases wich 
indeterminate classification as to' grade level or length of tiae in 
UB. An asterisk (*) is used to indicate a statistically significant 
(P < .05) difference. 

a/ 

— Standard errors presented are computed for the difference in rates for the 
total group of UB participants within a particular grade level. 

b/ 

— Computed by assuming all indeteraina:t:e continuation cases as continuing 
or completed. 

c/ 

— Computed by assuming all indeterminate continuation cases as not 
continuing or completing. 

d/ 

— Unweighted cell size in computing P and P 

max min 

e/ 

— Computed by adjusting weights for indeterminate continuation/completion 
cases. 



1/ r. 



nweighted cell size in computing ? 
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be seen, significantly higher rates exist for the UB group in the tenth 
grade on all three estimates (^^^y ^min' ^adj^* ^ continu- 

ance/completion rate differences for eleventh and twelfth graders are mixed 

(reflecting, in part, the fluctuation of P and P in the CS group), 

max min 

but none of the differences approach statistical significance. 

As in the previous subsection, three comparisons for each of the three 
rates were made within the UB group to discover. a possible relationship 
between length of program participation and HS educational continuance. No 
such relationships were found (the maximum absolute difference observed was 
2.3 percent and the minimum standard error computed was 2.6 percent), and 
the results of these analyses are not reported. 

While the fall to fall continuance rates are less stable (larger 
standard errors due to smaller number of cases) and subject to some possible 
bias (as specified in Chapter 3, Section VI), it is somewhat surprising 
that full year high school continuance does not appear to be related to 
extent of UB participation except for the tenth graders. The finding is 
more surprising in light of the emphases placed by the UB program on con- 
centration of efforts within eleventh and twelfth grade and on the summer 
component of the program. It is precisely in these areas of concentration 
that the program seems weakest with respect to HS continuance. (Note that 
previously established continuance/completion advantages for eleventh grade 
UB participants within the academic year dissipate when full year rates are 
considered. This suggests, of course, that the summer dropout rate for 
these UB participants is greater than that for the CS group.) Unfortunately, 
it is not possible to compute, from available data, separate continuance/ 
completion rates for the subset of UB participants who actually were enrolled 
in the 1974 UB summer program. Consequently, the hypothesis that UB students 
who actually participate in the summer program do persist at higher rates 
than do. the CS group cqunterparts could not be explored. Even if this 
hypothesis were true, the fact remains that UB participants (in general) do 
not continue (or complete) HS education on a year-to-year basis at any 
higher rate than a comparable group of nonparticipants . 

C. PSE Enrollment 

Differences in PSE entry rates may be considered more or less inde- 
pendently of difference in high school continuance by appropriately defining 
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the population of students eligible for PSE entry. One such subpopulation 
of students is made up of high school graduates. Regardless of high school 
completion (except in the case of 0 percent completion) , PSE entry rates 
for UB and CS subgroups of this population can be computed and compared. 
Another population of eligibles may be defined in light of the current 
trends toward "open door" postsecondary institutions for which high school 
graduation is not a necessary requisite for admission. The second popula- 
tion is thus defined as all students not in high school; the former group 
(high school graduates) is a proper subset of the latter, PSE entry rates 
were determined for both such subgroups (i.e., UB and CS students who had 
graduated from high school by fall 1974, and UB and CS students no longer 
in high school in fall 1974) , 

PSE entry rates for the total subgroups of UB and CS eligibles are 
given in Table 7.13. Due to the large percentage of indeterminate responses, 
the only rates given are those in which weight adjustments for. indeteriPinate 
response were mrde (analogous to the P^^^ values for HS continuance). For 
the HS graduate subgroup, the rates are further partitioned by length of 
participation in the UB program. Differences between UB and CS groups in 
PSE entry rates are conspicuously large. Not only is the entry rate signifi- 
cantly greater for the UB group in a statistical sense, it is also of 
considerable practical significance due to the absolute magnitude of the 
difference. Among high school graduates, less than half of the CS group 
enter PSE as compared to almost three-fourths of the UB participants. 
Among the all eligible group (including high school dropouts), it is esti- 
mated that 13 of 20 UB students enter PSE, as compared to 8 of 20 in the 
balanced CS group. 

Within the UB HS graduate subgroup, two additional independent a priori 
comparisons were made. High school graduates who had joined UB in or prior 
to the eleventh grade continued into PSE at a 4 percent higher rate than 
those joining in the twelfth grade, but this difference was not statistically 
significant when compared to a standard error of 4.1 percent. Graduates 
who had joined UB prior to or in the tenth grade entered PSE at an 8.9 
percent higher rate than those joining' in the eleventh grade, which did 
represent a statistically significant difference with an associated standard 
error of 3.6. 
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Table 7.13 

POSTSECONDARY ENROLLMENT RATES FOR UPWARD BOUND 
PARTICIPANTS AND COMPARISON STUDENTS 



i - ■ ■ 

Population 
Considered 




Grouo 


Standard 
Error^^ 


UB in 
Program 
in Grade 10 


UB Joining 
Program 
In Grade 11 


UB Joining 
Program 
in Grade 12 


UB Total 
Group 


CS 


High School, 1 
Graduates— 


Rate 
N^/ 


73.1% 
191 


69.2% 
366 


68.2% 

343 


* 70.7% 
900 


46.7% 
413 


5.3% 


All 

Eligibles^' 


Rate 
N^/ 


X 


X 


X 


* 65.1% 
1135 


42.5% 
618 


4.6% 



NOTE: Reported percentages are based on weighted data, using weights balanced 
within grade level, corrected for fall 1974 subsampling, and adjusted 
for cases with indeterminate classification as to grade level or length 
of time in UB. An asterisk (*) is used to indicate a statistically 
significant (P < .05) difference. 



— Standard errors presented are computed for the difference in rates for the 
total group of UB participants within a particular grade level, 

— ^ Reported rate represents PSE entry during or prior to, fall 1974 f:or 
students classified as high school graduates in fall 1974, 

c/ 

— Unweighted cell si2es. 

Reported rate represents PSE entry during, or prior to, fall 1974 for all 
members of the sample classified as not in high school in fall 1974, For these 
computations 5 weights were also balanced over grade level. Cases with inde- 
terminate PSE entry status (less than 0.1 percent and 0.3 percent, respectively, 
of the UB end CS weighted totals) were assumed aoj: Co have entered PSE. 
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UB participation, therefore, seems highly related to PSE entry, in 

both a qualitative and quantitative sense. Program participation, regard- 

21/ 

less of length of such participation — ' , is strongly related to an enhanced 
FSE entry rate'. Further, among those who complete high school, PSE entry 
rate is positively related to length of participation in the program. 

It should be pointed out that the PSE entry rates reported in Table 
7.13 reflect, for the greater part, immediate PSE entry (i.e., entry into 
PSE within a year of graduation or dropout) . Higher levels of "lag entry" 
rates among the CS group (i.e., entry into PSE over a longer time span) 
could reduce the original advantage of the UB participants. The data of 
this study do not, however, allow examination of this possibility or of 
other hypotheses regarding lag -ntry. Furthermore, data are not available 
from the current study to assess the PSE persistence within the two groups. 
That is, it is possible that the UB participants entering PSE do not remain 
there at as high a rate as the CS PSE entrants. Were this the case, PSE 
completion for the two groups could be equivalent or even greater for the 
CS group. The likelihood of such a possibility is, however, another matter, 
and without empirical evidence, any discussion of such likelihood would be 
little more than speculation. 

For the particular PSE entry rate employed in this study, the picture 
is quite clear. Participation in the UB program is highly related to a 
greater rate of entry into PSE. These results cannot be attributed to 
differences between the UB and CS groups in terms of differences in school- 
specific factors, academic risk status, poverty status, race, or sex, since 
these factors were controlled either in the study design or statistically 
through the balancing procedures. Other observed differences between the 
UB and CS groups for which statistical adjustments were not made (see 
subsection II. C of this chapter) could not explain differences in PSE entry 
rate of the direction and magnitude of those reported in Table 7.13, since 
the observed preprocess and extraprocess differences were typically quite 
small and in a direction which should have favored the CS group over the 
UB group. Moreover, the differences cannot be plausibly explained by the 

217 I ~ 

For most of the UB sample, participation consisted of at least one 
academic year. 
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fact that indeterminate response to PSE status in fall 1974 was fairly 
high. Possible bias due to nonresponse to the fall 1974 data collection 
(primarily through the subsampling scheme used) was pointed out in Chapter 3, 
section VI; however, given the small extent of this possible bias it is 
extremely unlikely that it cculd account for the substantial differences in 
PSE entry rate, even in the event that the bias was operating differentially 
for the UB and CS groups. There is always the possibility in survey 
studies of this type, however, that overlooked or unmeasured (and therefore 
uncontrolled) variables have confounded the results. 

Since results are based primarily on unverified student reports, 
another possible explanation of the .findings would be response bias on the 
part of students. To advance this as a tenable hypothesis for group differ-- 
ences, one would have to argue for differential response bias in the two 
groups. Given the loyalty of UB participants to their program, such argu- 
ments do have some intuitive appeal. Since some student reports were 
subjected to validation, and no differential response validity between the 
UB and CS groups was observed, explanations based on differential response 
bias are more tenuous. 

There are two remaining plausible explanations for this finding. The 
first, and perhaps most obvious explanation, is that participation in the 
UB program raises the probability of PSE entry. The second explanation is 
that some unmeasured variable, which is highly related to PSE entry, is a 
major factor in selection of students into the program. One such variable 
may be high motivation for educational continuance beyond high school. 
Some insight into this latter possible explanation will be, gained in subse-- 
quent sections of this ch^.pter. 

D. Longitudinal Educational Continuance 

It is possible, by use of the Markov model for educational continuance 
introduced in Chapter 2, subsection XI. B, to examine long-term educational 
continuance for the UB and CS groups. This use of synthetic cohorts allows 
computation of high school graduation rate, given tenth grade entry, for 
various UB entry patterns. These values were computed and are presented in 
Table 7.14. The high school graduation probabilities shown in Table 7,14 
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Table 7.14 



PROBABILITIES OF HIGH SCHOOL COMPLETION AND PSE ENTRY, 
GIVEN TENTH GRADE ENTRY, AS A FUNCTION OF DEGREE 
OF EXPOSURE TO UPWARD BOUND 







Exposure 


to UB 






3 or More 

Years 
(Entered UB 
in Grade 10 
or Earlier) 


2 Years 

\ ■C'Xl u c u e a U JO 

in Grade 11) 


1 Year 
v,iiuterea Uo 
in Grade 12) 




No 

Exposure 
(CS) 


High School Graduation: 










Probability 


.750 


.696 


.694 


.703 


a/ 

Difference- 


+.047 


-.007 


-.009 




Standard Error of 
Difference 


.060 


.042 


.049 




PSE Entry: 










Probability^^ 


.602 


.527 


.472 


.316 


a/ 

Difference:— 


+.286 * 


+.211 * 


+.156 * 




Standard Error of 
Difference 


.052 


.051 


,049 





NOTE: 



a/ 



Probability values reported are computed by multiplying year- 
to-year continuance/completion rates, adjusted for indeterminate 
classification variables and continuance/completion index. The 
results reflect balancing of the CS group. An asterisk (*) is 
used to indicate a statistically significant (P < .05) difference. 

- Difference is CS group probability value subtracted from UB' group 
probability value. Positive differences, therefore, are favorable to the 
UB group. 

For twelfth graders, the probability of transition from twelfth grade 
to college is computed and multiplied by lower grade continuance rates 
Probability values reported cannot, therefore, be exactly reconstructed 
from previpusly presented results. 
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may be computed directly- (within rounding error) from the entries of Table 
7.12.^/ 

The probabilities of PSE entry, given tenth grade entry, cannot be 
obtained directly from information presetiuCfd previously. Transition prob- 
abilities from tenth to eleventh grade and from eleventh to twelfth grade 
were obtained from Table 7.12 entries. The probabilities of PSE entry, 
given twelfth grade entry, were not, however, precisely equivalent to the 

-/iili^es obtained by multiplying twelfth grade, fall-to-fall continuance 

23/ 

T>Li.ij' by PSE entry rates among high school graduates. — 

The information presented in Table 7.14 mirrors the findings previously 
reported. Probability of twelfth grade completion given tenth grade entry 
±B not significantly related to UB participation, regardless of the extent 
of that participation. On the other hand, probability of PSE entry given 
tenth grade entry is significantly related to UB participation, and the 
extent of UB participation seems linearly related to an increase in this 
probability. 



IV. DIFFERENCES BETWEEN CS ANC UB STUDENTS ON 
FACTORS RELATED TO SUCCESS IN PSE 

The third major objective of the UB program is to provide UB students 
with the skills and motivation necessary for success in PSE. As previously 
discussed in Chapter 1, subsection III.C.3, the extent to which the program 
is meeting this objective could not be directly evaluated due to difficulty 



— ' For example, the probability of high school graduation given tenth 
grade entry and exposure to UB for 2 years (from grade 11 through graduation) 
is given as .696. This figure is obtained by multiplying: (1) probability 
of eleventh grade enrollment, given tenth grade entry and no UB participation 
in grade 10 (i.e., CS) ; (2) probability of twelfth grade enrollment, given 
eleventh grade entry and UB participation in grade 11; and (3) probability 
or twelfth grade completion, given twelfth grade entry and participation in 
UB during eleventh and twelfth grades. Performing the multiplication with 
the P^^j rates yields (.855) x (.914) x (.890) .6955. 

23/ 

— This is due to the fact that some twelfth graders did not graduate 
but did continue in high school. 
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in defining and/or measuring such variables, SucceoS in meeting the objec- 
tive may, however, be examined indirectly by examining differences between 
the UB and CS groups on factors theoretically and empirically related to 
success in PSE, Such an examination is the subject of this section, 

A. Academic Factors 

HS academic measures are generally quite predictive of success in PSE. 
Specifically examined in this subsection are three of the change measures 
defined in section I of this chapter: (1) change in academic grade point 
average, (2) change in proportion of academic credits passed, and (3) 
change in proportion of credits taken that could be classified as academic.—'^ 
The first and second variables listed above are indices o£ changes in high 
school academic achievement. It seems reasonable that a program attempting 
to recruit high risk students and to provi^'e them with skills necessary for 
success in PSE would attempt to improve such achievement. The third 
variable is an index of course load concentration. In preparation for 
entry to 2- and 4-year colleges (stressed by the UB program) it would seem 
reasonable to emphasize a greater concentration of courses in the academic 
area. 

The results of analysis of these variables are presented in Tables 
7.15, 7.16, and 7.17. Little in the way of conclusion can be drawn from 
the results due to the extremely high incidence of indeterminate data.— ^ 
Although the differences in indeterminate data percentages are not statis- 
tically significant for the UB and GS groups (or for different subgroups of 



24/ 

— The other change scores discussed in section I showed such small 
variation that they were not analyzed. 

25/ 

~ The extent of the indeterminate data problems shown in Tables 7.15 
through 7.17 may be somewhat surprising in light of the extremely high 
return rates (over 99 percent) of these forms. Indeterminate response 
for these data is, however, compounded by many factors. First, access 
to transcript files was, in some cases, refused (although other informa- 
tion reported on the STF was available). Second, incomplete data were 
provided on many fonD,s (due to lack of information on transcripts re- 
garding "current" grade course averages). Finally, the algorithm for 
reducing the available STF data produced indeterminate data if too few 
academic credits were attempted, or if too few courses could be classi- 
fied as either academic or nonacademic, or if grading systems were not 
amenable to the normalizing conversion used (see Appendix E) . 
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Table 7.15 



CHANGE IN ACADEMIC GRADE POINT AVERAGE FROM 
NINTH GRADE TO CURRENT GRADE FOR UPWARD BOUND 
PARTICIPANTS AND COMPARISON STUDENTS 







I ' — — -J 

Student Group 


Current 
Grade 




UB in 
Program at 
Grade iU 


UB Jo T n "1 n 

Program in 
Grade 11 


UR TfTinint^ 

Program in 
Grade 12 


UB Total 
Group 


CS 




Indeterminate^'' 
c/ 

Mean Change— 


54.2% 


54.1% 


59.9% 


56.4% 


45.7% 


12 


162 


305 


328 


795 


348 




— U. Ul / 


0. 025 


0. 156 


0.062 


-0. 001 




143 


244 


192 


579 


375 




a/ 

Indeterminate— 
c/ 

Mean Change— 


47.1% 


49.0% 




48.5% 


41.7% 


11 


143 


447 




590 


279 




-0.117 


-0.048 




-0.066 


-0.157 




157 


397 




554 


422 




Indeterminate^'^ 
c/ 

Mean Change— 


40.6% 






40.6% 


42.5% 


10 


197 






197 


248 




-0.147 






-0.147 


-0.121 




304 






304 


443 



NOTE: Percentages and means reported are based on, weighted data, after balancing. 



— Percentage of indeterminate responses, representing item nonresponse, 
multiple response, and inconsistent response. 

— ^ Number of cases wrlth indeterminate responses, 
c/ 

— ' Computed for determinate responses only. 
— Number of cases with determinate responses. 
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Table 7.16 

CHANGE IN PROPORTION OF ACADEMIC CREDITS PASSED 
FROM NINTH GRADE TO CURRENT GRADE FOR UPWARD 
BOUND PARTICIPANTS AND COMPARISON STUDENTS 



Current 
Grade 


Student Grouo 


UB in 
Program at 
Grade 10 


UB Joining 
Program in 
Grade 11 


UB Joining 
Program in 
Grade 12 


UB Total 
Group 


CS 


a/ 

Ind e t er mina t 

12 

Mean Change^ 
N^/ 


46. OZ 
136 

-0.013 
169 


. 43.5% 
246 

-0.040 
303 


48.0% 
273 
-0.007 

247 J 


45.7^ 
655 

-0.022 
719 


33.5% 
221 

-0.028 
502 


a/ 

Indeterminate-- 
N^/ 

c/ 

Mean Change^ 
N^/ 


44.2% 
135 

-0.027 
165 


44.0% 
409 
-0.033 

435 




44.0% 
544 

-0.031 
600 


36.0% 
220 

-0.099 
481 


a/ 

Indeterminate— 
N^/ 

c/ 

Mean Change— 

=4/ 


35.4% 
172 

-0.095 
329 






35.4% 
172 

-0.095 
329 


40.1% 
196 

-0.082 
495 



: Percentages and means reported are based on' weighted data, after balancing, 



NOTE 
a/ 

Percentage of indeterminate responses » representing item nonresponse. 
multxple response » and inconsistent response. 

b/ 

^ Number of cases with indeterminate responses, 
c/ 

Computed for determinate responses only. 

d/ 

— Number of cases with determinate resnonses. 
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Table 7.17 



CHANGE IN PROPORTION OF ACADEMIC CREDITS TAKEN 
FROM NINTH GRADE TO CURRENT GRADE FOR UPWARD BOUND 
PARTICIPANTS AND COMPARISON STUDENTS 



Current 
Grade 




I ■ ■ " ■ — ■ ■ 

Student Group . 


UB in 
Program ac 
Grade 10 


UB Joining 
Program in 
Grade 11 


UB Joining 
Program in 
Grade 12 


UB Total 
Group 


CS 


12 


Indeterminate^'' 
c/ 

Mean Change— 


45.8% 
135 

-0.042 
170 


42.3% 
240 

-0.094 
309 


47.0% 
267 

-0.096 
253 


44.9% 
642 

-0.084 
732 


32.2% 
207 
-0.114 

516 


11 


a/ 

Indeterminate— 
c/ 

Mean Change— 
N— 


43.8% . 
134 

0.022 
166 


43.8% 
407 

-0.045 
437 




43.8% 
541 

-0.033 
603 


35.4% 
213 
-0.077 

488 


10 


.a/ 
Indeterminate— 

c/ 

Mean Change— 


34.6% 
167 

-0.021 
334 






34.6% 
167 

-0.021 
334 


39.5% 
191 

-0.038 
500 



NOTE: Percentages and means reported are based on. weighted data, after balancing. 



Percentage of indeterminate responses, representing item nonresponse, 
multiple response, and inconsistent response. 

Number of cases with indeterminate responses. 

c/ 

Computed for determinate responses only. 
Number of cases with determinate responses. 
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UB participants) in the huge majority of possible comparisons, it is not 
statistically sound to base conclusions on results which represent less 
than half of the available cases (regardless of the extent of weight adjust- 
ment perf omed) . 

With the magnitude of indeterminate data shown iu. Tables 7.15 through 
7.17, the mean change values reported (computed for determinate data only) 
could not be considered unbiased estimates unless the unrealistic assumption 
was made that students with available data were representative of those 
without such data. To the extent that such an assumption is false, the 
table entries could change considerably. There is, however, no support 
from the data for a relationship between UB participation and change in 
academic -related factors- In fact, for some comparisons, the results are 
not even in the expected direction. The picture painted by Tables 7.15 
through 7.17 is, perhaps, a surprising one, showing a general slight decrease 
in academic success and percent of academic credits taken from grade nine 
to current grade for both the UB and CS groups. This pattern is quite 
consistent regardless , of the student subgroup considered; however, the 
meaningfulness of these changes is in question, given their small absolute 
value and the extent of indeterminate responses. 

B. Aspirations and Expectations 

Of the many motivational aspects related to PSE success, two of the 
easiest to measure are plans and expectations. Part of the UB program 
function is to raise participants' aspirations to attend college and to 
provide them with reasonable expectations that these aspirations will be 
met. This aspect of UB function may be examined for the subset of BSQ 
respondents. 

Table 7.18 presents the stated plans for entry into PSE (BSQ item 36) 
for BSQ respondents in the UB and CS groups, by grade level. The proportion 
of indeterminate data is low and quite similar for both groups, thus the 
results should not be greatly attenuated as a result of nonresponse. For 
every grade level considered, UB participants plan PSE entry at significantly 
higher rates than their CS counterparts. (The results presented previously 
in section III.C show that these plans are, in fact, realized for a large 
proportion of the UB group) . 
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Table 7.18 



PLANNED ENTRY INTO POSTSECOND^lRY EDUCATION 
WITHIN FOUR YEARS FOR UPWARD BOUND PARTICIPANTS 
AND COMPARISON STUDENTS BY GRADE IN SCHOOL 



Fall 73 
Grade , 
Level~- 






Group 


Standard Error 
of Difference 


Entry Plans 




UB 


CS 




Plans to enter 




86.2% 


* 




72.2% 


4.1 


12 


Does not plan to 
Inde.tenninate^^ 


enter 


8.6 
5.2 


* 




22.3 
5.5 


4.0 

c/ 




Plans to enter 




82.2 


* 




63.5 


3.7 


11 


Does not plan to 
Indeterminate^^ 


enter 


12.4 
5.4 


* 




29.3 
7.2 


4.3 
1.8 




Plans to enter 




76.3 






64.3 


4.2 


10 


Does not plan to 
Indeterminate^^ 


enter 


13.8 
9.9 


A 




28.7 
7.0* 


3.1 
2.2 



NOTE: Reported percentages were co^iputed using weighted data, after 
balancing and adjusting for' instrument nonresponse, for that 
subset of students eligible for BSQ administration. Data pre- 
sented in this table were obtained from responses to item 36 
of the BSQ. An asterisk (*) is used to indicate a statistically 
significant (P < .05) difference. 

a/ 

— Determined from most raiiable data source available in master file, 
b/ ^ J 

— Indeterminate response represents item nonresponse, multiple 
response, and inconsistent response. 

c/ 

— Standard errors were not computed for absolute differences less 
than 1 percent. 
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Table 7.19 shows the highest level of educational attainment toward 
which the two groups of BSQ respondents aspire, as well as the level of 
education they actually expect to attain (BSQ, item 30) . Levels of inde- 
terminate data are low and not statistically different for the UB and CS 
groups. Differences between the groups in both aspiration and expectation 
are statistically significant, and the patterns of responses clearly show 
that UB participants both aspire to and expect higher levels of education. 

Another factor related to plans for edncaiional continuance is occupa- 
tional plans. Some occupac:::^nrs require a lon^^r period of PSE (or different 
forms of PSE) than others. Z:\e occupational r-spirations and expectations 
for the two groups of BSQ respondents (BSQ, item 34) are shown in Table 
7.20. Although the proportions of indetermijiate data are relatively high 
for these variables, they are not statistically different for the UB and CS 
groups. The UB group members desire and expect to be in o:^cupations x^hich 
require greater amounts of education beyond HS (e.g., professional positions 
requiring some graduate training, school teacher) at significancly 
greater rates than CS group members. Although this finding is somewhat 
clouded by the high rate of indeterminate data, it is completely consistent 
with previous findings. 

In summary, it seems clear that UB participants plan and expect to 
attend PSE in greater propor^:ions and for longer periods than the CS group. 
This greater motivation for «^ducation continuance after high school should 
be directly related to the higher incidence of PSE entry in the UB group. 
The question remains, however, as to whether this motivation was affected 
by the UB program. There is simply not enough available information from 
this study to determine whether the UB program was instrumental in raising 
participants' motivation to attend PSE or whether selection into the program 
"'s based to some extent on already extant motivation. The latter hypothesis 
is supported by reports of some project staff during site visitation. 

C. Actions Taken in Preparation for PSE 

The counseling components of many UB projects include direction in 
preparation for PSE. If such counseling is effective, it would be expected 
that UB participants would take more preparatory actions than members of 
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Table 7.19 



HIGHEST EDUCATIONAL ATTAINMENT DESIRED AND EXPECTED 
FOR UPWARD BOUND PARTICIPANTS AND COMPARISON STUDENTS 











Desired 


Expected 


Highest 

Educational Attainment Level 


TTH 




Standard 
Error of 
Difference 






Standard 
Error of 
jjir r cix^ence 
















inol rxnxsnea nxgn scnoox 


0.4% 


0.9% 






0.7% 


1.3% 




Finish high school 


6.6 


13.2 


* 


2.0% 


11.6 


22.3 


* 2.1% 


Training in military service 


3.0 


4.5 


* 


0.7 


4.3 


5.6 


0.7 


Vocational, technical , 

business , or trade school 


7.0 


15.3 


* 


1.8 


8.8 


13.2 


* 2.2 


Two-year or junior college 


8.3 


8.3 




a./ 


13.7 


14.8 


a/ 


Four-year college 


27.0 


19.9 


* 


1.8 


34.6 


21.6 


* 2.5 


Graduate or professional 
school 


41.0 


31.0 


* 


2.1 


20.3 


16.6 


2.6 


I Indeterminater-'' 


6.6 


6.8 






5.9 


4.6 


1.0 


r — ....... ' , 













NOTE: Reported percentages were computed using weighted data, after balancing 
within grade and over grade and adjusting for instrument nonresponse, 
for that subset of students eligible for BSQ administration. Data pre- 
sented in this table were obtained from responses to item 30 of the BSQ. 
An asterisk (*) is used to indicate a statistically significant (P < .05) 



difference. 

a/ 

— Standard errors were not computed for absolute differences less than 
1 percent. 

Indeterminate response represents item nonresponse, multiple response, 
and inconsistent response. 
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Table 7.20 



DESIRED AND EXPECTED OCCUPATIONS OF UPWARD BOUND 
PARTICIPANTS AND COMPARISON STUDENTS 





Desired 


Expected 


Occupation--^ 


UB 


CS 


Error of 
Difference 


UB 


CS 


O LdllUdrU 

Error of 
Difference 
















Clerical 


5.7% 


11.2% 


* 1.4% 


7.3% 


12.7% 


* 1.8% 


Craftsman 


3.2 


8.2 


* 1.8 


3.0 


8.8 


* .1.5 


Fam Work 


0.1 


0.3 


y 


0.1 


0.4 


y 


Homema ke r / Ho u s ewif e 


0.1 


0.4 


y 


1.4 


1.8 


y 


Laborer 


0.0 


0.6 


y 


0.5 


1.8 


0.7 


Manager/ Administrat or 


2.4 


3.4 


y 


1.8 


1.8 


y 


Militairy 
Dperativer- 


1.6 


1.2 


y 


1.9 


1.7 


y 


0.5 


2.2 


* 0.5- 


0.7 


2.1 


* 0.6 


Professional I— 
e/ 

Professional II— 


26.3 

13 8 


22.9 


2.4 

X.J 


21.8 

inn 


18.4 

. u 


1.9 

•tin 
^ 1 .u 


Ptoot^t et or / Ownef 


0.8 


1.0 


y 


0.4 


0.5 


y 


Protective Service 


1.0 


1.1 


y 


1.0 


0.9 


y 


Sales 


0.4 


0.2 


y 


0.5 


0.7 


y 


School Xeacher 


10.0 


5.6 


* 1.2 


9.7 


5.4 


* 1.3 


Service Worker 


4.8 


5.9 


0.9 


4.1 


6.9 


1.4 


Technical 
Indeterminate^''' 


4.3 
25.1 


4.0 
25.7 


y 
y 


3.7 
32.2 


3.0 
28.6 


y 

2.0 








_ , 









NOTE: Reported percentages were computed using weighted data, after balancing 

vithin grade and over grade and adjusting for instrument nonrasponse^ 
for that subset of students eligible for BSQ administration. Data pre-- 
sented in .this table were obtained from responses to item 34 of the BSQ. 
An asterisk (*) is used to indicate a statistically significant (P < .05) 
difference. 

a/ 

— For more detciiled descriptions of these categories, see BSQ item 34, 
Appendix D. 

b/ 



Standard errors were not computed for absolute differences less than 1 percent. 
Such as meat cutter, machine operator, welder. 

Professions typically requiring no more than a 4-year college education. 
Professions typically requiring more than a 4-year collage education. 



ERIC 



y 
y 

y 

Indeterminate response represents item nonresponse, multiple response, and 
inconsistent response. 358 
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the CS group. Some insight into this aspect of UB operation may be gained 

by examining the responses of certain subsets of BSQ respondents, although 

26/ 

the results should be viewed with more than usual caution. — 

Item 38 of the BSQ requested information concerning whether students 

27 / 

had taken any of nine specified actions — in preparation for possible PSE 

entry. This question was addressed only to that subset of BSQ respondents 

who stated plans for entry into PSE within a 4-year period. Table 7.21 

shows the distribution of the number of actions taken by grade level for 

28 / 

the UB and CS groups. — Percentages of indeterminate data for i.^:f;se 
responses are quite low and are not different for the UB and CS group.?. It 
can be seen that for both eleventh and twelfth graders, UB participants 
have taken significantly greater numbers of preparatory actions, on the 
average, than have members of the CS group. 

Items 40 and 41 of the BSQ requested information relative to actual 
application to PSE by the subset of BSQ respondents who were twelfth graders 
and who stated plans for PSE entry. The distribution of numbers of appli- 
cations made by UB and CS group members is given in Table 7.22. The propor-. 
tion of indeterminate data is extremely small within each group and is not 
differential between the groups. On the average, UB participants have made 
application t v a significantly greater number of PSE institutions than have 
their CS cohorts. 

Item 42 of the BSQ requested information concerning acceptance into 
PSE by the subset of BSQ respondents in the twelfth grade who reported both 
plans for PSE entry and application to at least one PSE institution. 



26 / 

— The results reported in this subsection are based on a set of BSQ 
items that were part of a nested skip pattern. In such a pattern, the 
nature of the response to one of the items determines whether or not an 
individual will answer subsequent items. The number of individuals re- 
sponding to an item will typically decrease for items that are more deeply 
nested in the skip pattern, and thus the subset of respondents on which 

a particular set of results are based will be specified. 

27 / 

— These actions included visits to a campus, taking admission tests, 
and formal and informal inquiries concerning various aspects of PSE entry 
(see Appendix D) . 

20 / 

— Due to the small numbers of tenth graders who had taken any such 
actions, tenth grade results are not reported. 
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Table 7.21 

NUMBERS OF PRELIMINARY ACTIONS TAKEN TOWARD PSE 
ENTRY BY UPWARD BOUND PARTICIPANTS AND 
COMPARISON STUDENTS BY GRADE 



\ 


Number of 


Group 


Standard 


Grade 


Actions Taken: 


UB 


CS 


•Error of 
Difference 




a/ 

Indeterminate— 


2.1% 


0.9% 


0.6% 




0 


0.9% 








1-z 


2.2% 


16.4% 




12, 


3-4 


7.3% 


16 . 6% 






5-6 


0 0 "7 <y 


28.5% 






7 or more 


64 . 8% 


34.5% 






b/ 
Mean— 

N^/ 


6.86 
1000 


5.17 

388 


* 0.27 




a/ 

Indeterminate— 


4.4% 


4.5% 






0 


2.9% 


10.6% , 






1-2 


12.2% 


24.3% 




11 


3-4 


25. 6% 


30.0% 






5-6 


31.7% 


. 22.2% 






7 or more 


23.2% 


. 8.2% 







Mean— 


4.81 
870 


3.39 - 
335 


* 0.23 



NOTE : 



Reported values were computed using weighted data, after balancing 
and adjusting for instrument nonresponse, f or that subset of 11th 
and 12th grade students eligible for BSQ administration and stating 
plans to enter PSE. Dp.ta presented in this table were obtained 
from responses to item 38 of the BSQ. An asterisk (*) is used to 
indicate a statistically significant (P < .05) difference. 



a/ 



— . Indeterminate response represents complete item nonresponse, multiple 
response, and inconsistent response. 

b / 

— • Computed for determinate responses only, 
c/ 

^ Unweighted cell sizes. 

Standard errors were not computed for absolute differences less than 
1 percent. _ ^ 
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Table 7.22 



NUMBERS OF POSTSECONDARY INSTITUTIONS TO WHICH APPLIC/.TIONS 
WERE MADE BY UPWARD BOUND tARTICIPANTS AJID COMPARISON S'HJDENTS 



Number of 


Group 


S tandard 






Error of 


Applications Made 


UB 


CS 




a/ 

Indeterminate— 


1.1% 


0.4% 




0 


20.2% 


33.1% 




1 


26.2% 


39.3% 




2 


12.1% 


10.8% 




3 


15.3% 


7.7% 




4 


7.2% 


3.9% 




5 


8.2% 


3.3% 




6 or more 


9.7% 


1.6% 




Mean— 


2.26 


1.26 


* 0.25 




980 


383 





NOTE: Reported values are computed using weighted data, after balancing 
and adjusting for instrument nonresponses, for that subset of 12th 
graders eligible for BSQ administration, stating plans for PSE 
entry, and providing determinate response for item 38 of the BSQ. 
Data presented in this table were obtained from nonresponses to 
items 40 and 41 of the BSQ. An asterisk (*) is used to indicate 
a statistically significant (P < .05) difference. 

a/ T J 

— Indeterminate response represents item nonresponse, multiple response 
and inconsistent response. 

Computed for determinate responses only. 

c/ 

— Unweighted cell sizes. 
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Acceptance rates for the UB and CS groups are presented in Table 7.23. ^' 
Although the acceptance rate for the UB group is higher by almost IC percent 
than that for the CS group, the difference is not a statistically significant 
one. 

In summary, these data support the hypothesis that the UB program is 
facilitating actions taken in preparation for PSE entry, including applica- 
tion. Differences between the two groups in motivation to attend PSE, 
discussed in the previous subsection, have been eliminated to some extent 
by restricting these analyses to the subset of students planning PSE entry. 
Because of the restriction to this subgroup, quantitative motix'ational 
differences cannot provide a plausible alternative explanation of this 
finding, although qualitative differences in degree of desire to attend PSE 
may still exist. While preparatory actions and application rates are 
higher in the UB group, actual acceptance into PSE among those students wh o 
apply is not significantly greater for UB participants. The major function 
of the UB program in this area, therefore, appears to be that of aid lii the 
Initiation of actions leading to :admission rather than aid in gaining 
admission once application has been made. It should be noted, however, 
that the UB program is working with large proportions of "high risk" students. 
The higher application rate among UB participants, would, therefore, likely 
include among the group of UB applicants greater proportions of these high 
risk students than among the CS applicants. If this Is the case, then even 
a similar acceptance rate for UB participants would suggest that the UB 
program facilitating PSE admission among those who apply. Moreover, the 
time frame in which data relating to PSE admission were obtained (April and 
May BSQ administrations) somewhat clouds the question of admission rates 
among applicants. It is likely that some additional UB applicants and CS 
applicants were accepted* during the late spring and summer for admission to 
PSE for the following fall semester. 

D. Availability and Adequacy of Financial Aid for PSE 

Obtaining adequate financial aid is clearly a necessary condition for 
poverty level students to attempt (much less succeed in) PSE* The UB 
program is intended to assist participants in applying for and obtaining 
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Table 7.23 

ACCEPTANCE INTO PSE OF UPWARD BOUND PARTICIPANTS 
AND COMPARISON STUDENTS 





Group 


Standard 
Error of 
Difference 


UB 


CS 


Not Accepted 
Accepted 

a/ 

Ind e t e rmxna t e-^ 


17.8% 
76.9% 
5.3% 
779 


27.9% 
68.9% 
3.2% 
237 


5.9% 

5.8 

1.7 



NOTE: Reported values were computed us^.ng weighted data after balancing 
and adjusting for instrument nonresponse for that subset of 
twelfth graders eligible for BSQ administration and stating 
application to one or more PSE institutions. Data presentt^d 
in this table were obtained from nonresponses to item 42 of the 
BSQ. None of the differences reported in this table are statis-- 
tically significant (P < .05). 

Indeterminate response represents itsam nonresponse, multiple response, 
and inconsistent response. 

Unweighted cell sizes. 
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adequate financial aid packages. If this function of UB is being success- 
fully effected, then UB participant; who have applied to P3E irxstitutions 
should also apply for financial aid in greater proportions than the analogous 
CS group members. Moreover, of those applying for aid, UB participants 
would be expected to obtain adequate aid in greater relative numbers. 

Table 7.24 presents data pertaining to application for, offer of, and 
perceived adequacy of financial aid for subgroups of the UB and CS respondents 
to the BSQ. The percent of students applying for aid was computed only for 
those students who indicated they had applied for PSE, so the percentages 
reported do not reflect the greater application rate for the UB group. 
Among those twelfth grade students applying to PSE, a much greater percent- 
age of UB participants have applied for financial aid (slightly over half 
of the CS .subgroup but almost 90 percent of the UB subgroup). 

Those twelfth grade BSQ respondents who reported applying for financial 
aid were asked to report whether or not aid had been offered. As shown in 
Table 7.24, the proportion of D'B aid applicants who reported offer of aid 
was not significantly different from the comparable proportion of CS aid 
applicants. It should be noted that indeterminate response rates (repre- 
senting primarily item nonresponse) for this variable (item 45B of the BSQ) 
were quite high but not differential between the UB and CS subgroups. If 
one assumes that the distribution of the indeterminate responses among the 
two response categories would be the same regardless of UB membership 
status, then the finding of no difference would be maintained. Without 
such an assumption, however, differential distribution of the nonrespondents 
could produce results favoring either the UB or C: aid applicants. It 
should be pointed out that these res:lts are time-point dependent, since 
data collection was in spring 1975. It is possible that substantial numbers 
of either or both groups were .subsequently" of fered aid. 

Those twelfth graders reporting offer of aid in response to item 45B 
of the BSQ were asked to evaluate the adequacy of the aid which had been 
offered. Among this subset of BSQ respondents, significantly smaller 
percentages of UB participants reported offer of inadequate aid tlian did 
nonpar ticipants, as shown in Table 7.24. Indeterminate response rate, 
while not different for the UB and CS subgroups, was again quite high, thus 
attenuating these results. 
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Table 7.24 



APPLICATION FOR, OFFER OF, AND ADEQUACY OF FINANCIAL AID 
FOR POSTSECONDARY EDUCATION BY UPWARD BOUND PARTICIPANTS 
AND COMPARISON STUDENTS 





Group 


Standard 




UB 


CS 


Error of 
Difference 


a/ 

Application for Aids- 








Has not applied 


11.4% 


46.8% 


* 5.3% 


nas appliea 


87 . 7% 


53.2% 


* 5.4% 


Indeterminate-^^ 


0.8% 
738 


0.0% 
228 




Offer of Aid:-^ 








Has not been offered 


16.8% 


19.3% 


7.1% 


Has been offered 
Ind e t ermina t 
N^/ 


42.3% 
40.9% 
650 


43.2% 
37.6% 
111 


£/ 
9.0% 


Adequacy of Aid Offered:-^ 








Not adequate 


15.8% 


35.7% 


* 9.0% 


Adequate 

Indeterminate^^ 

N^/ 

1 : • : ~i 


47.4% 


33.7% 


7.1% 


36.9% 


30.6% 


10.4% 


291 


67 






NOTE: Reported values were computed using weighted data, after balancing 

and adjusting for instrument nonresponse, for that subset of twelfth 
graders eligible for ESQ administration. An asterisk (*) is used 
to indicate a statistically significant (P < .05) difference. 

a/ 

- Computed from responses to item 45 of ESQ for that subset of individua.ls 
stating application to onti or more PSE institutions. 

^/ T ^ . . 

indeterminate response represents item nonresponse, multiple response, 
and inconsistent response. 

c/ 

Standard errors were not computed for absolute differences less than 
1 percent. 

- Unweighted cell sizes, 
e/ 

- ^ Computf.d from responses to item 45E and 48 of ESQ* for^that subset of 
individuals stating application for financial aid. 

Computed from responses to item 49 of ESQ for that subset of individuals 
stating offer of financial aid. 
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This same subgroup of BSQ respondents (twelfth graders reporting offer 
of financial aid) werf>- asked to report the dollar amounts of aid they had 
been offered from that institution which they felt they would most likely 
attend. The total aid package was to be reported separately for three 
categories of aid (grants, loans, and work study). Table 7,25 reports the 
average dollar amount reported for each of the categories by ths UB and CS 
subgroups and also indicates indeterminate response rates.— ^ From Table 
7.25, it can be seen that the subgroup differences in offered aid packages 
approach statistical significance only in the area of grants, for which UB 
participants report an average offer of over $500.00 more aid. Relatively 
high, though nondlfferential, indeterminate response rates again cloud the 



issue, 



The results presented in this subsection are attenuated, for the most 
part, by high rates of indoterminate rev;ponse. Moreover, the results 
reported have been obtained on a rapidly shrinking data base, so that some 
reported values are based on fewer than 50 cases. The increase in standard 
errors associated with the statistics does account for the smaller number 
of cases, but interpretation of observed differences between UB and CS 
become more tenuous due to the fact that the equivalency between the total 
UB and CS groups, obtained by balancing, deteriorates as one considers 
smaller and smaller subsets of the data. 

Even in light of the limitations imposed on these analyses, the pattern 
of results presented in this subsection is consistent with the expectations 
of one familiar with the program. The results indicate that proportionately 
more UB applicants to PSE apply for financial aid than do comparable non- 
participants and that while UB aid applicants do not receive offers of aid 
in greater relative number.?, they do receive offers of more adequate aid. 
The greater adequacy of aid seems to come from offers of larger grants ^ 



29/ 

For these data, it was again the case that the large portion of inde- 
terminate re^sponse represents item nonresponse, although a small percentage 
represented out--of-range responses (e.£,., a reported offer of a grant for 
$50,000,000). If a determinate dollar amount was reported for any of the 
three aid categories, an individual was assumed to have responded to this 
ite-ci, even though the other responses were not given. In such cases, a 
lack of response to some other aid category was assumed to represent $0.00. 
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Table 7.25 



AMOUNT OF FINANCIAL AID FOR POSTSECONDARY EDUCATION 
OFFERED FROM SELECTED SOURCES TO UPWARD BOUND 
PARTICIPANTS AND COMPARISON STUDENTS 



Source 




Group 


Standard 
Error of 
Difference 


UB 


CS 












Grants 


a/ 

Ind e t erminat er^ 
Mean-- 

b / 

Standard Deviation— 


21 .1% 
$1134.05 
$1562.48 


18.3% 
$ 621.52 
$ 804.81 


7 9.7 
$263.40 


Loans 


a/ 

Indeterminate^ 
Meanr- 

Standard Deviation—^ 


20.1 
$ 370.00 
$.549.01 


26.8 
$ 424.53 
$ 658.58 


8.4% 
$140.50 


Work Study 


.a/ 
Ind e t e rmxnat e— 

Meanr- 

Standard Deviation^'' 


22.5% 
$ 181.46 
$ 308.51 


18.3% 
$ 76.81 
$ 294.54 


7.8% 
$ 58.10 


Cell Size 




291 


67 





NOTE: Reported values were computed using weighted data, after balancing 

and adjusting for instrument nonresponse, for that subset of 
twelfth grade students eligible for BSQ administration and stating 
offer of financial aid. Data presented in this table were 
obtained from responses to item 50 of the BSQ. None of the 
differences reported In this table are statistically significant 
(P < .05). 

a/ 

— Percent of indeterminate responses ^ including complete item nonresponse, 
multiple and out-of~range respons<i, atic' inconsistent response. 

Computed for determinate responses only. 
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V. OTHER STUDENT OUTCOMES 



In addition to the major objectives of the UB program, the program 
encourages additional practices which suggest the importance of other stu- 
der^t outcomes. Some of these outcomes were measured in this study and are 
the subject of this section. As in the previous section, the student 
outcome measures considered were obtained from and pertain to specific 
subgroups of the total UB and CS samples. 

A. Further Educational Outcomes for HS Dropouts 

Although not a major goal, the UB program encourages attempts to 
motivate HS dropouts to continue their ed;o,ation. This rjay be affected by 
return to HS or through other channels such .as High School Equivalency 
Education Programs (HSEEP) . The short span 'of data collection efforts 
coupled \7±th the sample definition allowed 'insufficient opportunity to 
build dropout return into the general model of HS educational continuance. 
Moreover, the student questionnaire (D/TQ> ;:esigned to elicit information 
regarding both UB and CS group HS dropouts was returned at such low rates 
as to render almost useless any analyses of the scanty data collected. 

Some information was available for HS dropouts, however, regarding 
HSEEP entry and subsequent completion. These data are presented in Table < 
7.26. Larger proportions of UB dropouts than CS dropouts had entered some 
HSEEP program, and proportionately more of the UB dropouts had received an 
equivalency diplom^i by fall. 1974. The differences between the UB and CS 
groups were not, however, statist-^cally significant. 

B. Types of PSE Entered 

Although the stated goal of the program regarding PSE entry does not 
suggest any particular type of PSE, program philosophy (which was reflected 
in the site visit reports and the physical location of ^ru-st projects) 
emphasize the importance of applying to and enrolling in 4-year colleges 
or universities. This subsection addresses th " emphasis. 

Table 7.27 summarizes the responses of UB and CS group members to an 
item of the ESQ which requested information concerning the types of PSE 
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Table 7.26 



PARTICIPATION OF UPWARD BOUND AND COMPARISON GROUP 
HIGH SCHOOL DROPOUTS IN HIGH SCHOOL EQUIVALENCY 
EDUCATION PROGRAMS (HSEEP) 









a/ 

Participation Status In HSEEP- 


Group 


Standard 
Error of 
Difference 


UB 


CS 










Entered some form of HSEEP 
since leaving high school 


50.1% 


37.7% 


7.5% 


Received HS equivalency diploma 


32.6% 


26.9% 


8.4% 


Number of cases (unweighted) 


261 


202 













NOTE: Reported percentages were computed using weighted data, after 
balancing within and over grade level and correcting for fall 
1974 subsampling, for that subset of group members classified 
as high school dropouts. None of the differences reported in 
this table are statistically significant. 



— For purposes of these analyses, indeterminate responses are assumed 
not to have participated in HS equivalency programs. 
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Table 7.27 

PERCFNTAGES OF UPWARD BOUND PARTICIPANTS AND COMPARISON 
STUDENTS APPLYING TO SPECIFIC TYPES OF PSE INSTITUTIONS 



( ■ — 


- - -' — - 


a/ 

Institution Type- 


Group 


Standard 
Error of 
Difference 


1 UB 


CS 


Public Vocational/Technical/ 
Business School 


28.2% 




47.2% 


* 6.7% 


Private Vocational/Technical/ 
Business School 


8.5% 




8.3% 


y 


Public 2-Year College 


24.9% 




27.6% 


4.0% 


Private 2-Year College 


7.8% 




7.7% 


'2.1 


Public 4-Year College 


72.8% 




54.9% 


* 4.9% 


Private 4-Year College 


37.7% 




16.6% 


* 5.0% 


Number of Cases (unweighiied) 


779 


237 











NOTE: Reported values were computed using weighted data, after balancing 

and adjusting for ihstr'-vnent nonresponse, for that subset of twe]fth 
graders eligible for BSQ administration and stating application to 
one or more PSE institutions. Data presented in this table were 
obtained from responses to item 44 of the BSQ. For purposes of 
these computations, indeterminate responses (accounting for 7 
cases and 2 cases for UB and CS respectively and for 1 percent and 
0.2 percent of weighted totals within the respective groups) were 
considered as not having applied to any of the categories of PSE. 
An asterisk (*) is used to indicate a statistically significant 
(P < .05) difference. 

a/ • • 

— Application to one type of institution does not preclude appli^cation 

to another type so that percentages are not constrained to sum to 100. 
b/ 

" Standard errors were not computed for absolute differences less than 
1 percent. 
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institutions to which students had made application for admission • The 
percentages reported were computed only for that subset of twelfth grade 
BSQ respondents who had indicated application to one or more PSE institu- 
tions. As seen in the table, a significantly greater proportion of UB 
participants applied to 4-year colleges then did their CS cohorts. 
Conversely, a significantly smaller proportion of UB students had applied 
to public vocational, technical, and business schools. 

Table 7.28 indicates the type of PSE institutions in which UB and CS 
group members actually enrolled. The percentages reported in Table 7.28 
are based on the subset of UB and CS group members who indicated that they 
had attended some form of PSE during or prior to fall 1974. A substantially 
and significantly greater proportion of thL. JB subgroup had enrolled in 
4-year colleges or universities, while a significantly smaller proportion 
of the UB subgroup had enrolled in 2-year colleges and certain types of 
other training schools (i.e., vocational, trade, busriness, etc.). Thus, in 
both application and enrollment, the UB participants reflect the emphasis 
on placement in 4-year colleges or universities . 

VI . SmiMARY 

The analyses presented in this chapter have been directed toward 
comparative student outcomes for UB participants and a statistically balanced 
CS group. The results are qulv.e consistent in support of a major central 
theme: namely, for most outcomes relating to PSE, the UB group differs 
substantially from the CS group » but for other outcomes the grou ps do 
nct > differ . With few exceptions, this theme is pervasive, even for results 
that may be attenuated due to excessive or differential proportions of 
indeterminate data. 

UB participants show greater motivation for fSE entry and for occupa- 
tions requiring higher levels of, education- They take more preliminary 
actions in preparation for PSE; they apply to and enter PSE institutions 
with greater relative frequency; they apply for financial aid in greater 
relative numbers; and the aid packages which they are offered are more 
adequate. Although the /SE entry rate is greater for UB participants, this 
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Table 7.28 

TYPES OF POSTSECONIJARY EIJiJCATION INSTI-:S55a:i^NS ENTERED BY 
UPWARD BOUND PARTIC];PANTS AND COMPARISON STJ2>EmS 



Type of PSE Institution 


a/ 

Percentage Attending— 


Standard 
Error of 
Difference 


UB 


CS 


Vocational, trade, business, or 
OLuer career Lraxnxng scnoox 
got requiring a high school 
diploma- 


3.3% 


8.0% 


2.8% 


Vocational, trade, business, or 
other career training school 
requirina a high school 
diploma- 


4.8% 


16.3% 


* 3.9% 


Junior college or community 
college (2-year) 


17.2% 


31.3% 


* 5.8% 


Four-year college or university 


75.7% 


45.1% 


5^ 5.2% 


Number of Cases (unweighted) 


832 


252 





Reported values were computed using weighted data, after balancing 
and correcting for fall 1974 subsampling on the s'jbset of students 
classified as attending or having attended some PSE institution in 
fall 1974. An asterisk (*) is. used to indicate a statistical 
significant (P < .05) difference. 



For purposes of these computations, indeterminate- responses (accounting 
for eight cases in the UB group ^nd one case in the CS group — i percent and 
0.6 percent of the unweighted within group totals, respectively) wera con- 
sider'?.d as not having entered. As a result of this data treatment and the 
fact that an individual may have attended more than one of the specified 
types of PSE institutions (or some other type of institution), percentages 
are not constrained to add to 100 percent over PSE type. 

— Percent attending vocational/technical schools is closely approximated 
by adding percents for the two subclassif ications presented, since overlap 
(attendance at both types of institutions) occurred only once in the UB group 
anr* once in the CS group. 
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may be due more to the higher applicetion rate, since acceptance rates 
among those who apply are nc greater for the UB group. Further, although 
tb.:^ aid packages offered to UB participants are seen as more adequate, 
there is no evidence that UB participants who apply for financial aid are 
offered aid at any higher rate than nonpar ticipant aid applicants. 

The type of PSE institution to which UB participants apply (73 percent), 
and enter (76 percent), in greatest numbers ii? the 4-year institution. 
Application to and entry into this type of institution is almost double the 
rate of the CS group. Given the typically greater selectivity and cost of 
this type of ir-^.titution, the higher PSE entry rates are more impressive 
but the largei' financial aid packages are less impressive. The results are 
quite compatible with what one might expect from a UB project situated at 
a four -year college, emph?-sizing the importance of PSE entry, providing 
paid visits to other colleges, providing counseling and other assistance in 
applying for admission and financial aid, and having solid contacts winh 
admission and financial aid officers at several PSE institutions. 

Given equalization (by design and statistical adjustment) of the group 
on important preprocess variables, the small number of observed statis- 
tically significant differences between the groups on uncontrolled pre- 
process and extraprocesE:; variables, the virtual lack of practically 
significant differences on those srame variables, and no observed differen- 
tial response bias on the part of the two groups, there seem to be only two 
plausible explanations for differences in PSE outcomes of the magnitude 
observed in this chapter. Either the program is facilitating PSE outcomes 
for participants, or students are selected for program participation, 
explicitly or implicitly, on the basis of some characteristic that is 
highly related to PSE outcomes. One such characteristic may be high moti- 
vation for educational continuance beyond high school. It was observed 
that UB. participants plan and expect to attend PSE in greater proportions 
and for longer periods than the CS group. This greater motivation for edu- 
cation continuance after high school should be directly related to the 
higher incidence of PSE entry in the UB group. The question remains, 
however, as to whether this motivation was affected by the UB program. 
There is simply not enough available information from this study to 
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definitively determine whether the UB program was instrumental in raising 
participants' motivation to attend PSE or whether selection into the program 
is based to some extent on already extant motivation (although site visit 
observations and interviews did indicate that some projects recruited 
students on the basis of existing motivation for PSE enrollment). 

The data do support an hypothesis that the UB program is facilitating 
actions taken in preparation for PSE entry , including application. Dif- 
ferences betweexi the two groups in motivation to attend PSE were reduced to 
some extent by restricing the analysis to the subset of students planning 
PSE entry. Because of this restriction, quantitative motivational differ- 
ences cannot provide a plausible alternative explanation of this finding, 
altho-vgh qualitative differences in degree of desire to attend PSE may 
still exist. ITnile preparatory actions and application raies are higher in 
the UB group, actual acceptance into PSE among those students who apply is 
not significantly greater for UB participants. The major function of the 
UB program in this area, therefore, appears to be that of aid in the ini- 
tiation of actions leading to admission rather than aid in gaining admission 
once application b^^s been made. It should be pointed out again, however, 
that the UB program is working with large proportions of ^'high risk" students. 
The higher application rate among UB participants would, therefore, likely 
include among the group of UB applicants greater proportions of these high 
risk students than among the CS applicants. If this is the case, then even 
a similar acceptance rate for UB. participants would suggest that the UB 
program is facilitating PSE admission amc;ng those who apply. 

Th ere is, however, little evidence to indicate that the UB program 
is inst ru-ngnta l in increasing HS retention among participants . For one 
group or participants (tenth graders) , participation in the program does 
appear to be related to reduced full-year dropom: rates; however, this does? 
not imply that higher retention rates among tenth graders would he reaJ izert 
by all projects were they to enroll tenth graders. Recalling that few UB 
projects enrolled tenth graders in substantial numbers, it follows that a 
large proportion of the tenth grade UB participants come from a small 
proportion of the UB projects. Success with HS continuance of tenth graders 
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may be due, therefore, to practices unique to those projects recruiting 
large numbers of tenth grade (or younger) students. 

There is some indication that the UB p rogram m ay be facilitating 
potential success in PSE . Although definition and measurement problems do 
not allow examination of skills and motivation that are necessar y for PSE 
success, some measures of academic skills and some omponents of motivation 
were examined. In terms of increased HS GPA, proportion of academic courses 
taken, or proportion of advanced courses taken, there is no indication of 
any relationships to UB participation for the gain . .s employed in 

this study. There is, however, evrldeuce that UB part- ,.^ts receive 
larger and more adequate financial aid packages, vhich should facilitate 
their success in PSE. Further, higher levels of desires and expections for 
entry into, and further continuance in, PSE are observ(?.d aicong the O'B 
participants, although this cannot be directly attributed to participation 
in the program. In some cases, these findings were attenuated by a large 
percentage of indeterminate data and/or a small number of cas6::s. Further, 
the particular measures used for this :^valuation may be questioned. Thus a 
true evaluation of the third major objective cannot be made from the data 
of the current study. The overall thrust of the results would, however, 
indicate that the UB program is providing services that facilitate success 
in PSE. 
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Chapter 8 

Student Outcoiaes as Related to Project Characteristics 



I. GENERAL 

In the previous chapter, student outcomes for UB participants ^ere 
examined at a national program level • The natural question arises (quite 
independent of the previous comparisons of the UB and CS groups) as to 
whether certain project characteristics are related to dif f ei-entiaJ. UB 
participant outcomes. That is, are certain structural and/or functional 
characteristics of projects associated with "more desirable" or "less 
desirable" student outcomes? An examination of this basic question is the 
focus of this chapter. 

Obviously, UB projects can be classified according to certain input 
and process variables; in Chapter 5, characteristics of the UB projects 
were examined, and a considerable extent of variation among projects was 
indicated along several structural and functional dimansions. There are 
projects that s^^lect primarily black participants and others that direct 
their efforts toward Mexican-Americans or Native Americans, Similarly, 
there are projects operating within the environment of a""2-year PSE insti-- 
tution and others operating at 4--year institutions. Function-^l process 
differences also exist, with some projects r^ore heavily emphasizing remedial 
academic instruction and others vjith a greater emphasis on personal growth. 
Of greater interest, however, is a classification (or set of classifications) 
of projects in terms of output (for purposes; .f this chapter, output will 
be defined in terms of the student outcomevs; caarained in Chapter 7). Given 
that UB participants enter PSE at much high<ix rates than the CS group, are 
some projects characterized by very high PSE entry rates and others by very 
low rat^s, or do all projects maintain a more or less equivalent rate? 
This question was not addressed in Chapter 7; and if, in fact, such variation 
exists among projects, then an examination of the nature of * the variation 
as a function of other project characteristics is possible • 
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The question addressed in this chapter is a sensitive one, involving 
implications of differential effectiveness of U3 projects • There is every 
reason to expect that projects differ in terms of their effectiveness as 
measured by student outcomes; only the extent of the variability is in 
question. It is also quite logical to assume that there are reasons why 
some project!:^ are more effective than others. It should be pointed out, 
however, that the variability in effectiveness is relative variation . The 
absolute magnitude of the variation, or deviations, of UB projects from 
some absolute base is not the major focus of these analyses. Rather, any 
existing variation will be examined and attempts will be made to identify 
its sources. 

The analyses used to address these questions were conducted in the 
spirit of relational analysis. Significant contribi. ..ions of an ^'inde- 
pendent,'' "predictor," or "discriminatory'' variable in i statistical model 
in no way suggests that changes in the variable in question causes the 
dependent variable to change. Findings from such exploratory analyses 
should not be used indiscriminately to alter programs but rather should be 
further examined in planned variation studies that follow the logic of 
experimental or quasi^xpcrimental design (from which cauration may be 
logically inferred). The analyses should be considered exploratory for two 
major reasons: first, the program characteristic or function variables as 
well as the student outcomes are based on questionnaire data- that are subjec 
to reporting error and , biases; second, no*- enough is known about the ITB 
program to test well-defined models of the UB process. It should also be 
noted that the major goal of this study was to examine the overall impact 
of UB and not to evaluate specific Upward Bound strategies. In order to 
conduct a comprehensive evaluation of the impact of program factors within 
UB, measures of UB prograiu functions and processes should be based upon 
comprehensive and detailed measures and observations of program functioning 
by trained unbiased observers* The measures in the present study are not 
a=i comprehensive, detailed, or unbiased as those measures typically used in 
program evaluation. However, some neasures are available from project 
level questionnaires which attempt to measure at: a gros-?. level some UB 
processes that might be relevant to the successful operation. 
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There are several alternative ways of seeking answers to these ques- 
tions, and the present chapter presents the results of one such approach. 
Given the joint constrairxts of data, time, and funds, the plan adopted is 
considered co be near optimal. Since the approach differs both concep- 
tually and methodologically from previous analysis, considerable preliminary 
explanation seems warranted. For that reason this introductory section 
will constitute a rather lengthy departure from the presentation of analysis 
results. It is felt, however, that a basic understanding of the concepts 
guiding and contributing to these analyses is extremely important to the 
understanding and interpretation of specific results. 

A. Basic Approach to Analysis 

Several interrelated decisions (involving considerations of data 
quality and availability, time and budget constraints, statistical appro- 
priateness, ease of presenting results, and generalizability of results) 
guided the choice of an approach to analysis of project variation. The 
final choice was between two basically diff erent ^ approaches , reflecting 
two different philosophies of data analysis. On the one hand, the data 
could be used to calculate national parameter estimates with all analyses 
weighted and adjusted. This would require computation of appropriate 
standard errors for the estimates which would compensate for the differential 
selection probabilities and other effects of the complex sample design. 
The other approach is that of considering only the 54 projects sampled and 
making no attempt to g .eralize beyond these 54 projects. Concomitant with 
these two approaches to data analysis are two differing points of view 
regarding the thrust of the results. In providing national estimates, the 
analyses would reflect the classical estimation and hypotheses-testing 
philosophy— identifying project characteristics that are significantly 
related to student outcome me^.:;ures on a national level. The other approach 
reflects an hypothesis-gener :v -v;> philosophy— examining the sample data for 
patterns and relationships aru, using obtained results to generate hypotheses 
that would be subject to test in subsequent studies. 

The procedure chor>en was primarily an hypothesis-generat v 3 approach. 
There are rcveral reasons for relying so heavily on the hypothesis-gener- 
ating philosophy. First, the study design va^ n^.ore appropriate for testing 
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hypotheses concerndng the major analysis questions of national program 
evaluation than for testing for differential program ef f ectiv^iness . Due 
to this emphasis, the sampling plan was devciloped to produce more precise 

. .'Oates of student parameters than of project parameters. Second, the 
depdi of analysis that could be performed for a national perspective was 
considerably more limited than that which could be achieved when ex/^Aining 
only the sample data.— ^ Third, due to tha extremely large number of poten- 
tial variables, and the limited number of cases (a maximum of 54 projects), 
the analyses progressed through a sequence of steps, w?>th resort to post 
ho c^ methods and data dependent analysis techniques. For these reasons, the 
analyses presented in this chapter were conducted using unweighted data. 
The tradeoff made as a result of accepting the hypothesis-generating 

approach is that the results do not necessarily generalize to the popula- 

2/ 

tion of UB projects.— 

B. Data Aggregation 

As indicated above, the aim of this set of analyses is to explore the 
possibility of relationships among UB input, process, and output variables. 
Given the nature of UB, the program-rel^' ad processes operate on UB students 
at the project level; hence, the unit of analysis for this chapter is the 
project, which provides the most meaningful and interpretable analytic 
base. In order to organize the data base for a project-orieated analysis, 
several preliminary procedures were necessary. In general, the approach 
was to produce a single measure at the individual project level for each 
attribute of input, process, and output considered. This was accompli-»hed 
by project level aggregation of student data and staff data; in the latter 
case, aggregation within and across staff category was possible. The 
resulting manipulations produced a data base of 54 observations (projects) 



— The more powerf-al — and more appropriate — multivariate techniques used 
in this chapter can be used in the hypothesis testing approach, but with 
the sample design employed in this study, computation of appropriate stand- 
ard errors is extremely expensive in both time and money. Without such 
standard errors, however, resultant estimates could be misleading c^ven 
though they would be statistically unbiased. 

2/ 

— One set of analyses, involving a multiple regression approach to the 
relationship between input, process, and output variables (see section III), 
does include an investigation of the use of sampling weights and estimates 
of design effects i'::f luencing the gtj^i^ard error of various estimates. 
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on a set of variables covering student preprocess ir^easures (project input), 
project structure and function (project process), and student outcome 
measures (project output) . 

There were two aggregation processes — corjbining d ^ta provided by 
staff and combining data provided by studiintfj. In each case, the aim was 
to incorporate equivalent data elements, available from different individ- 
uals within a project, to a single aggregate value of that data element at 
the project level. The staff data were collected from three sources — 
project directors, counselors, and instructors. For each project there was 
one director, typically several counselors and instructors, and from 0 to 
174 students. Table 8.1 presents the distribution of samf. - sizes and 
response rates, by project, for the three staff categories and students. 
This table indicates the m aximnm number of cases available for aggregation 
of any variable. For any given variable, however, these numbers were 
reduced due to .elimination of variables containing indeterminate responses 
(item nonrasponse, multiple responses, or inconsistent response). 

The aggregation procedure for the staff data involved either one or 

two steps, depending on the variable considered. The first step was an 

aggregation within staff category (for those staff categories with more 

than one possible respondent). For any given variable, this step involved 

computing an average value based on the available valid responses of all 

3 / 

counselors or all instructors from a given project.— This process provides 
a single average item value within each staff category for each project. 



— Note that the directors required no aggregation since there was only 
one possible respondent per project. For counselors or instructors, if 
all responses within the staff category were indeterminate (e.g., if all 
counselors from a project failed to respond to some item), then the project 
aggregate value of the variable for that staff position was also indetermi- 
nate. If only one staff member, of those responding, had provided a deter- 
minate response for a given item, then the project aggregate item value for 
that staff category mirrored that single response. 

— As discussed in Chapter 5, an attempt was made to produce an index of 
variability as well as an average value for each item. Due to the fact 
that only one counselor responded for sevsral projects and that there were 
relatively high levels of item nonresponse among both counselors and instruc- 
tors, the variability index was inappropriate for many items and projects 
and was, tlierefore, not atialyzed. 
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Table 3,1 



SAMPLE S12E3 AND RESPONSE HATES FOR UB PROJECTS 



Project 


Dtreccors 


Counselors 


las true cors 


Scudeuts 


— - ■ 














Raspoiideii^ 




Nuziber 






ResDOade 


Sampled 


?^;i3r3nded Sainpled 


Saspled 


1 


X 


1 


1 


3 


1 




68 


_ 

75 


I 1 


i 


^ — u 


3 


3 


3 


3 


62 


63 


3 


i 


1 


1 


1 


2 


5 


53 


64 


U 


1 


1 


0 


0 


5 


6 


100 


104 


5 


0 


1 




2 


2 


4 


56 


81 


6 


1 


1 


2 


2 


1 


4 


79 


83 


7 


1 


1 


3 


3 


2 


3 


108 


113 


8 


1 


1 


1 


1 


4 


5 


122 


133 


9 


1 


1 




2 


U 


4 


69 


76 


10 


1 


1 


2 


3 


1 


3 


64 


72 


11 


1 


1 


1 


2 


1 


4 


33 


39 


12 


1 


1 


1 


1 


3 


3 


37 


38 


13 


1 


1 


1 


T 


4 


4 


62 


65 


14 




1 


2 


1 


3 


4 


72 


81 


15 


1 




-> 


2 


4 


4 


76 


84 


16 


1 


1 


1 


1 


4 


5 


50 


52 


1? 


1 


1 


3 


3 


3 


3 


17 


18 


18 


1 


1 


-> 


T 


4 


4 


62 


66 


19 


1^ 


1 


2 


2 


4 


4 


65 


67 


20 


1 


• 1 


1 


1 


3 


3 


47 


48 


21 


1 


1 


2 


2 


4 


4 


91 


97 


22 


1 


1 


2 


2 


2 


2 


25 


26 


' 23 


1 


1 


2 


2 


4 


4 


120 


125 


24 


1 




1 


2 


3 


4 


95 


101 


25 


1 


1 


2 


2 


2 


4 


164 


174 


26 


1 




2 


2 


2 


4 


90 


94 


27 


1 


1 


2 


2 


3 


4 


3-\ 


40 


28 


1 


1 


-» 


2 


4 • 


4 


o6 


74 


29 


1 


1 


2 


T 


4 


4 ^. 


58 


GO 


30 


1 


1 


2 


2 


4 


4 


65 


69 


31 


1 


1 


I 


1 


4 


5 


70 


75 


32 


1 


1 


3 


4 


2 


2 


47 


47 


33 




1 


1 


2 


1 


4 


64 


63 


34 


1 


1 ■ 


1 


■ 1 


2 


5 


83 


34 


35 


0 


1 


1 


2 


1 


4 


66 


75 


JO 


0 


X 


0 


2 


4 


4 


38 


53 


37 


1 


1 


2 


T 


4 




34 


40 


38 


1 


1 


2 


2 


3 




53 


55 


39 


1^ 






2 






46 


49 . 


uO 


0 


1 


1 


2 


3 




71 


77 




1 


1 


1 


1 


4 


5 


46 


50 




1 


1 


4 




2 


2 


69 


70 


43 


1 


1 


1 


2 


2 


4 


77 


79 


44 


0 


1 


0 


0 


2 


3 


34 


37 


45 


, 1 


1 


J 




1 


4 


113 


115 


46 


1 


1 


0 


0 


2 ' 


6 


32 


40 


47 


1 




2 


2 


3 


4 


44 


53 


48 


i 


1 


1 


2 


3 


4 


39 


42 


49 


1 


■ 1 


1 


: 


3 


5 


0 


0 


50 


. 0 


1 


1 


2 


3 


4 


63 


70 


51 


1 


1 


1 


1 


5 


5 


118 


125 


52 


1 


1 




2 


2 


4 


59 


63 


53 


1 


1 


3 


3 


1 


3- 


32 


32 


54 


1 


\ 


1 


4 


2 


2 


27 


29 













.NOTfi.: -*rojecc 49 vas a ntiw project: and ac th-a cine of che survey it had no students 
in the appropriate grades. 

— ^ Returned at least one of the various student questionnaires. 
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The various me^ns are based on differing numbers of cases depending upon 
the number of staff sampled, the number responding, and the icem response 
rates involved for a given variable. 

Given the three staff category aggregates, a second seep was taken 
for variables coramoii to all three staff questionnaires (see Chapter 2, 
subsection VII. D), involving the combination of data across the staff 
categories. Equal weighting of the responses from each staff category 
(regardless of the differing number of individuals in the separate cate- 
gories) insured that these over-staff aggregates would reflect each staff 
position equally. Hence, a simple average was comput,>i of the available 
within-staff aggregates. If the aggregate value for a given staff position 
was indeterminate, then that staff category did not contribute to the over- 
staff aggregate. In can be seen that in extreine cases it was possible for 
the over-staff aggregate to be based on the response of only one staff 
member for some variables.—^ 

The aggregation of the student data involved a much simpler process. 
A weighted u:ean was computed for each project based on the valid student 
data for that project. Indeterminate data were ignored in these computa- 
tions but weight adjustments were made, if required, to compensate for 
the fall 1974 subsampling.— ^ The number of cases avsilabu.a for comp.,ting 
this mean varied as a function of the size of the project and availability 
of determinate data. 



C. Variable Selection 

Several criteria were used to determine which variables were to be 
selected for these analyses. Variables were chosen to provide measures in 
three areas: (1) preprocess status of students, (2) project activities, 
procedures, and characteristics, and (3) student outcomes. Measures within 



— ' Discussion of the distribution of some of these staff aggregates has 
been presented in Chapter 5, section III. 

6/ 

— Those few variables, for which this extrame situation arose, were 
not used in subsequent analysis. 

-^^ The weight adjustments performed were analogous to those described 
in Chapter 7 invoU^ing a distribution of the weight of a nonsampled indi-- 
vidual to those other individuals in the same project: most like liim. See 
Appendix F for a more .detailed di,*9cussion of weight adjustment. 
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these areas were selected on the basis of face validity, variability, 
stability, and extent of indeterminate data. In other words, measur--'-^ were 
sought that reflected important attributes of the UB process (e.g.. .ud of 
instruction) or that were obvious candidates for outcome indices or for 
control of differences in initial selection of UB students (e.g.* ninth 
^rade GPA) . Additionally, the measures were exronined for within-^prcject 
and betwee-v-'project variability. Measures having little wil:hin project 
variability and high between project variability were preferred. Finally, 
the rate of indeLL- ruinate data was considered, and if this rate was high 
for a given data element, then that element was not included. 

The selected preprocess measures are listed in Table 8.2 (see Chapter 7, 
section I). The table' provides, for each variable, descriptive statistics 
for the distribution over projects of the aveilability of data for the 
variable as well as for the distribution of the project aggregate value of 
che variable. The data availability rate distributions indicate that, in 
generals the amount of indeterminate data on a project-by-project basis is 
relatively low. The worst case is for ninth grade GPA, for which determi- 
nate data were available for only 17 percent of the students at two projects. 
The distributions of the. project aggregates show reasonable variation and 
symmetry. 

Table 8.3 lists the student outcc'ia measures that were selected (see 
Chapter 7, section I), with an in cation of the variability over projects 
of data availability and value of the outcome measures. Since the output 
measures are most central to th:^. analyses, the full distributions of pro-^ects 
for the seven outcome measures are also presented in Tables 8.4 through 
8.6. The project-by-project data availability rates are not as high as 
those obtained for the preprocess measures. Specifically, for the two 
acadv.nic change measures the average project data availability rate is 
fairr; low, between 47 and 56 percent. The major factor leading to these 
low data availability rates was lack of current year academic information 
in the UB files (see Chapter 7, subsection IV. A) . The lack of data for the 
fall-to-fall HS continuance/completion rates and PSE entry rates reflects, 
primarily, those students who were not selected during the fall 1S74 sub- 
sampling procedure. The potential eff^-^ of the sizeable amount of 
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Table 8.4 

FREQUENCY DISTRIBUTIONS OF PROJECTS ON FIVE STUDENT OUTCOME MEASURES 







Outcome Measure 


ProT)orti.on 


Fall-to-Fall 

HS , 
_ . a/ 
Continuance— 


Twelfth- 
Graders 
Entering 
PSE- 


PSE 

EntT^nts in 

Vocational/ 
c/ 

Technical— 


PSE 
Entrants 
in 2-Year 
College^' 


j PSE 

in 4-Year 
College^' 


• 95 to 


I. GO 


17 




1 








4 


.90 to 


.94 


18 












2 


,85 to 


.89 


10 




3 








9 


.80 to 


.84 


2 




7 


1 






10 


.75 to 


.79 


3 




6 








8 


.70 to 


.74 


1 




4 








2 


.65 to 


.59 


1 




9 




. 1 




2 


.60 to 


.64 






5 








2 


.55 CO 


.59 






3 




1 




2 


.50 to 


.54 






1 








2 


.45 to 


.49 


1 




2 




1 






.^u to 


. 44 






5 




3 




1 


.35 to 


.39 






1 


1 


1 




3 


.30 CO 


.34 








1 


3 




1 


.25 to 


.29 






1 




2 




1 


.20 to 


.24 






X 


7 








.15 to 


.19 






1 


4 


10 




1 


.10 to 


.14 








7 


11 






.05 CO 


.09 






1 


14 


6 






.00 to 


.04 








22 


13 




2 


Data Unavailable-^ 


1 


2 


2 


2 


2 


Total 

~ 


54 

- 


54 


54 


54 


54 



NOTE: All of the outcome measures reported in this table are based on within- 
project proportions of students. 



— Based on all project participants for whom data were available, 
b/ 

— Basec on all twelfth grade project participants for whom data were available, 
c/ 

— Based on all project participants entering PSE for whom data were available. 

— There was one project with no students and one project with no seniors, which 
account for unavailable data. 

386 

8.11 

O 

ERIC 





E=3 






§ 






CJ 












i 
































H 










o 


M 






O 




CO 






H 






CJ 


w 


m 


b3 


Q 




»^ 




00 


O 
















rH 




CJ 









H 



o 



CJ 



Pi w 



H 
CO 



Q 

;=> 

H 
CO 



CJ M 











O M 


rH 








• 






in 


o <r 


rH 














in 


O 




CM 












m 




xn 


rH 


O 




• 


• 




m 


o <r 


rH 


o 


U rH 


rH 










o 




O 


u O 


rH 


1 








o m 


m 


rH 


u O 




1 


r 






o m 




CM 






r 


r 






o m 


m 




U CM 




r 


r 






o m 


rH 








r 


1 






u cn 


rH 




O CO 




• 


QJ 




1 


1-3 






















CO 






cd 
















CO 












u 


e 




<u 


O 






u 




o 


iJ 






3 




pti 


O 










U-l 

o 


O 










u 


<U 






P 






iH 












> 







-a o 

cd u-i 
u 

00 CO 

u P 

•H rH 

6 5 

(U > 

cd 

u u 

cd 

c: 

•H CO 

(U u 

cd o 
- 

CO o 
u 

G U 

-a -a 

=^ i 

u P 

CO c 

rH 

O Cd 

iJ 

CO o 

(U iJ 
00 

cd oj 
> 

CO 

CJ C 

p p 

CU CO 

I 

c o 

•H cd 

? j2 



(1) 



<u o 

CO • 
cd o* CO 

CO c CO 
cd o 

<U CD 

U rH 

. c ^ 

P cd 

CO CO -H 

Cd u 

Q) cd 

e • > 

0) 

^ cd s 

u o 

> 
cd 



B 
o 
u 

P 

o 



u 

p 
o 



CO 



C CO 
•H 'H 'H 
^ O ^ 

H a- u 



b3 
O 



vr3 

OD 

'U 

rH 

cd 



CJ 



o 


o 


CM 


CM 


U CN 










m 


o a\ 


O 


rH 


U rH 










O 


O <!■ 


CM 


rH 


AJ rH 










m 


O a^ 


CM 


o 


U O 












O <f 


CM 


o 


U O 


rH 










O O 


m 


o 






r 








o in 


m 


o 


■u o 


rH 


i' 


« 

1 






o o 


rH 




U rH 


rH 


r 


1* 






o in 






iJ rH 




1 


1 






o o 


CM 


CM 


iJ CM 




1* 


1 




(U 


















CO 






cd 






<u 










CO 












a 


i 












u 




o 


u 




u 


p 






O 










O 


O 










u 








p 






rH 




B 


Cd 




P 


> 




Z 



o 

•H 

U J3 
O 6 
a P 
o c 

5-1 

CU rH 

Cd 

C u 
•H O 

00 Q) 
S 

Cd iJ 

CO 

c 
<u 
c -a 

OJ p 
P CO 
CO o 

O t3 
cd 

CO ^ 
OJ 

00 U CO 

cd u m 

•r-j CO 
O 

CU OJ 



CO 



u 
> 

cd 



u 






(U 




cd 


•n 


o 


•H 


O 










cd 


CU 


CJ 


> 


1 


cs 




a 


•H 




•H 


CO 


s 






o 


iJ 




u 










u 


P 




•H 


o 


a 


B 




o 


(U 


CO 




-a 


•H 




cd 






u 


iJ 


CO 


cd 




cd 








(U 


o 








CO 






cd 




CO 










u 


p 




cd 


rH 






Cd 


P 




> 


CO 






cd 






<u 




iJ 


6 




•H 




cd 










i 




CO 




CO 


iJ 


u 


<u 


u 




CO 


<u 


P 




•r-j 


o 


P 


O 




o 


u 


CO 


u 


CU 



pC iM iM 
H O O 



W 
H 
O 
25 



,.••1 



ERIC 



387 

8.12 



indeterminate data fpr these variables was further investigated. It was 
found that the percent responding in a given project was not systematically 
related to the computed aggregate value of the process and preprocess 
variables for any of the output measures. Even though no relationship was 
found, it should still be kept in mind that for some projects the project 
aggregate is based on less than half the students.— Any systematic factors 
causing nonresponse within a project will be reflected as bias in the 
analyses. 

Independent of response rates, several points may be observed con- 
cerning the distributions of the output variables. First, there is mean- 
ingful variation among projects on most of these measures; for example, 
the range in PSE entry rates is from .08 to 1,00. Only the fall-to-fall 
continuance/completion rate and vocational/ technical school entry rate 
show marginal variability. While the absolute range for these variables 
is fairly wide, the great bulk of the projects fall in a very narrow band; 
the extreme base rates for these variables tends to limit variation. The 
distributions of the two academic change scores have means near zero, but 
there is a reasonable distribution of projects over the entire range of 
scores. In summary, these outcome measures seem to reflect relatively 
large differences in output between projects and show promise as a means of 
sorting projects. 

Another set of variables to .be considered are those dealing with the 
UB process. Basically, there are two categories of variables that pertain 
to uhis set of variables — staff characteristics and program characteristics. 
The set of staff characteristics was limited to a few areas that provide 
similar measures over the three staff categories (e.g., staff experience). 
The measures of program characteristics were limited to those measures for 
which data were common to the responses from staff members in all three 
staff categories (see Chapter 2, subsection VII. D). 



— The student aggregates within a project were computed using weighted 
data, and adjustments were made for nonresponse due to the fall 1974 sub- 
sampling. But the tacit assumption exists that nonrespondents would have 
responded in a fashion similar to the respondents most like them. 
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Beyond the desire to collect input from all staff categories, the 
problem of missing data constrained variable selection to some extent. The 
relational analyses planned for this chapter are quite sensitive to missing 
data. For some of the planned analyses, projects with missing data on only 
one of a large set of variables would have been removed from the analysis. 
In light of the relatively small number of initial analysis units (54) , it 
was considered better analytic practice to instead eliminate the variables 
with large amounts of missing data. This decision greatly restricted the 
selection of variables related to only one staff category, especially among 
project directors, where there was only one possible respondent per project- 

The selected process measures are listed in Table 8.7. They deal with 
(1) staff characteristics — training, experience, attitudes, and interpersonal 
relationships, and (2) project procedures — activities, functions, and types 
of instruction. Given the constraints on variable selection listed above, 
this set of variables still provides an adequate summary of the basic 
activities and staff attitudes that exist within a project. If differences 
exist in basic style of operation between projects, then this set of measures 
should reflect those differences. 

A final Get of project characteristics available for the analyses 
presented in this chapter are"th*2 indices of project groupings that were 
established in defining the sampling frame for the study. At the time of. 
sample frame construction, certain project characteristics were suspected, 
a priori , to be related to student outcomes. Information was therefore 
collected on several specific project dimensions prior to drawing the 
project sample. Six of these dimensions were selected to form a priorx 
clusters of projects. Table 8.8 lists these measures and the project 
categories defined by each measure; Appendix B provides more detail about 
the collection of these data and derivation of the categories. Each dimen- 
sion defines from two to five clusters of projects. It should be noted 
that these project classifications do reflect structural and functional 
project attributes in a general sense, but some reflect more the character- 
istics of the students served by the project. 

One final project attribute used in the analyses reported in this chapter 
was project size. This attribute was determined directly by the number of 
eligible students in the project as of fall 1973 (given in Table 8.1). 
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Table 8.8 
A PRIORI PROJECT GROUPINGS 



1 ""^ *: ' 1 

Project Classificailon 

TiTTTipn ^ 1 nvt 

LJ J.lildA O ^ \J 1.x 


Categories 


Number of Projects 
in Each Category 


Type of Sponsor 


2-Year College 
4-Year Collage 
Other 


6 
46 
2 


ijOcauxon ox xargei: 
Population 


Area within City 
Rural 

City and Rural 
Other 


6 
8 
8 

28 
4 


Racial Compasition 
of Project— 


Predominantly Black (80%+) 

Black and White 

Indian 

Spanish-speaking 
Other 


15 
13 

8 
15 

2 


Length of Project 
Operation 


Less than 2 Years 

2 Years 

3 or More Years 
Ind e t ermina t e 


10 
8 
34 


Project Emphasis 


Academic Skill 
Personal Development 
Combination 
Other 


26 
6 

19 
3 


Extent of Coordination 
with Other Programs 
for the Disadvantaged 


No Coordination 
Some Coordination 


24 
30 



— Categorization of projects is determined as follows: predominantly black 
means 90 percent or more black; black and white means both black and white 
membership greater than 10 percent, but no other racial group greater than 
10 percent; Indian means greater than 10 percent Native American; Spanish- 
speaking means Puerto Rican or Mexican American greater than 10 percent but 
Indian less than 10 percent; other includes all other. 
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Description of Statistical Methods 

The approach to analysis taken in this chapter differs considerably 

from that of previous chapters, both conceptually and methodologically. 

The purpose of this subsection is to provide the reader with a basic feel 

for the nature of the various statistical techniques used. Emphasis in 

this chapter shifts from that of examining each of several variables or 

questionnaire items separately (univariate analysis) to that of considering 

a set of variables simultaneously (multivariate analysis). The description 

of the multivariate methods will be extremely general, and will not provide 

a substantive knowled^^e of the statistical details of these methods (which 

could only be gained from a more extensive discussion) . The techniques 

are, however, discussed in greater detail in Appendix G and supplemental 

references are provided. Such general descriptions of complex statistical 

techniques, without introduction of appropriate 'uiathematical conventions, 

are inherently subject to some misinterpretation. For this reason, the 

reader is encourajred to consult Appendix G, or some other more compl-^^te 

9/ 

presentation of the techniques.— 

All of the techniques described in this subsection may be used either 
descriptively or inf erentially (i.e., either describing the relationships 
existing for a given set of data or inferring some relationship that may 
exist in the population from which the spt of data has been drawn) . Due to 
the exploratory nature of the questions addressed in this chapter, a descrip- 
tive approach is dictated (as previously discussed in subsection I. A). 

1. Factor An alysis—^ 

Factor analysis is a method for analyzing data whereby the 

underlying structure or pattern of relationships among multivariate 



— For a more detailed, but still basic, discussion of the statistical 
techniques used in this chapter, refer to: Nunnallv, J. Psychometric 
Theory . New York: McGraw-Hill, 1967. ' ' 

For a nontechnical introduction to factor analyses, see: Rummel, R. J,, 
Applied Factor Analysis . Evanston, Illinois: Northwestern University Press, 
1970. For a description of the actual computational procedures used, see: 
Nie, N. H*, et al. Stati stical Package for the Social Sciences (2nd edition). 
New York: McGraw-Hill, 1970. 
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data may be examined and assessed. Given the observed patterns of 

variation and covariation (correlation) among a set of variables, 

factor-analytic techniques allow for the identification of underlying 

factors , components > or dimensions which may explain the observed 

relationships. The basic characteristic of such techniques is that of 

data reduction, in that one seeks a relatively small set of common factors 

which adequately explain a substantial proportion cf the variation and 

covariation of a much larger set of empirical measures. While factor 

analysis is historically associated with exploratory analyses (i.e,, 

the identification of theoretical constructs underlying manifest 

behavioral measures), other applications of the method have developed.—^ 

Within the framework of this study, fact or -analytic techniques have 

been used as a measurement tool, to construct, from existing data, a 

few meaningful composite indices for use in subsequent analysis. 

Thus, many responses have been summarized by a few indices with, 

hopefully, little loss in meaning or explanatory power, 

12/ 

2. Cluster Analysis— 

Clustering may be generally defined as a technique whereby 
objects (or events) are categorized into groups (clusters) on the 
basis of their empirical attributes. (Although the attributes or 
variables may also be clustered, the present discussion will not 
address such an application of clustering.) While there are many 
functions of the attributes " which could be used in clustering, a 
commonly used criterion is that of similarity. That is, given a set 
o£ objects and a set of measures defined on the attributes of those 
objects, clustering techniques allow one to establish two or more 



— Factor analysis was initially employed in the area of identifying the 
underlying "'mental" factors which might explain variability of and: covari- 
ability among the scores of diverse ability and aptitude measures?* 

12/ 

— For an introductory discussion of clustering techniques , refer -to: 
Overall, J. E. and laett , C. J. Applied Multivariate Analysis . New York: 
McGraw-Hill, 1970. For a description of the actual computation procedures 
used, see: Levinsohn, J. R. and Funk, S. G. Cluster: A Hierarchical 
Clustering Program for Lar^e Data Sets . L. L. Thurstone Psychometric 
Laboratory, Research Memorandum No. 40. Chapel Hill, N.C.: University 

of North Carolina, February 1974. 
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empirically homogenous groups (i.e., the similarity of memb ers within 
a group is greater than that of the group members to members of some 
other group) . 

The clustering problem is one of two major types of problems 

addressed by profile analysis techniques. Specif icallyj, the problem 

in clustering Is that of establishing groups of objects that are 

similar, when no_ previous classification as to group membership is 

available (i.e., the empirical determination of similar groups on the 

basis of available measures)* Dther major types o£ profile analysis 

address the question of differentiation among known groups on the 

basis of available measures. One such technique, discriminant analysis, 

is discussed in the following subsection. 

13/ 

3. Discriminant Analysis- — 

Discriminant analysis is a technique which allows maximum dis- 
tinguishability (discrimination) between two or more predefined 
groups on the basis of a predetermined set of measures. 
The technique produces the weights necessary for those linear combi-- 
nations of the measures which define the dimensions'^ on which the 
groups are as statistically distinct as possible. lihile none of the 
original variables, when taken singly, may differentiate greatly 
between the groups, it is often possible to determine one or more 
linear combinations of these variables which easily allow one to tell 
the groups apart. The defined linear combinations resulting from the 
analyses are called discriminant functions. 

Once the discriminant functions have been determined, statistical 
tests are available to determine the relative degree of group differ- 
^ entiation that has been obtained. Moreover, it is possible, on the 
basis of the discriminant function (and other information such as the 
prior probabilities of group membership) to classify a new object 



13/ 

— For a more technical discussion of Discriminant analysis, refer to: 
Overall, J. E, and Klett, C, J. Applied Multivariate Analysis . New York; 
McGraw-Hill, 1970. 

14/ 

— The maximum number of allowable dimensions equals one less than the 
number of groups, or the number of variables, whichever is less. 
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(which did not contribute to the original analysis or for which group 
membership is unknown) as more likely belonging to one or another of 
the groups • This classification function may also be used to v«.rify 
the success of the discriminant analysis by classifying the original 
objects as to group membership on the basis of those functions and 
observing the degree of correct and incorrect classification in light 
of the known group membership > 
4. Multiple Regression— ^ 

Multiple regression is a very general statistical technique 
whereby the relationship of one variable (measure) to a set of other 
variables may be assessed. Generally, the technique allows the 
determination of that linear combination of the variables in the 
predictor set which best predicts (fihows the greatest zero-order 
correlation with) the single criterion variable. 

The important conceptual difference between multiple regression 
and simple bivariate regression is that of partial correlation. 
Specifically, in determining the beast linear combination of the 
predictor variables, it is importai.\t to go beyond the simple zero- 
ordei' relationship of each predictor to the criterion. This involves 
evaluation of relationships to the residual portion of 
the criterion variable which remains when the prediction of all other 
variables in the predictor set has been removed (partialed) . 

In addition to providing the necessary weights for producing the 

most predictive linear combination of the predictor variables, the 

2 

analysis yields a statistic, (the square of the multiple correlation 
coefficient) , which is a measure of the proportion of variance in the 
criterion variable which may be explained by the predictor variables 
considered simultaneously. 



— ' For an introduction to multiple regression, refer to: Draper, N. R. 
and Smith, H. Applied Regression Analysis . New York, Wiley, 1966. 
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5. Stepwise Approaches' ^ 

Because of the large ntimber of variable? involved in the analyses 
reported in this chapter (see subsection I-C) and the relatively small 
number of projects (maximum of 54), a full-model analysis could not be 
performed for either the multiple regression analyses or the discrim- 
inant analyses. A common tactic in cases such as this is the use of a 
stepwise approach to the solution. Stepwise approaches are sequential 
analysis techniques whereby at each step of the process one additional 
variable is added to the model on the basis of some established cri- 
terion. This addition of variables into the model continues, step- 
by-step, until none of the remaining variables (i.e., those not 
already in the prediction equation or discriminant function) meet the 
criterion for inclusion in the model. ^ 

While stepwise techniques typically provide testable regression 
or discriminant function models composed of considerably fewer than 
the total number of available variables, they may sometimes be mis- 
leading. Such techniques tend to make the most of chance variation 
among certain variables, and thus do not replicate easily across 
different samples unless truly strong relationships e>-ist among the 
variables. This tendency to produce spurious results and oversioiplif ied 
or nonrational models should be fully recognized by the reader when 
the results from stepwise approaches are examined. 



16/ 

— For a description of stepwise discriminant analysis, including computa- 
tional procedures used, see: Dixon, W, J. (Ed.) BMDP: Biomedical Computer 
Programs . Berkeley, California: University of California Press, 1975. For 
an analogous description of stepwise multiple regression, see: Service, J. 
A User's Guide to the Statistical Analysis System . Raleigh, N.C.: North 
Carolina State University, 1972. 

17/ ^ , . . 

— For example, m stepwise multiple regression, the variable which 
explains the greatest proportion of the previously unexplained variation 

in the criterion variable would be a candidate for inclusion in the regres- 
sion model. 

18/ ^ T . 

— For example, m stepwise multiple regression one may wish to stop the 
process if none of the remaining candidates for inclusion into the regres- 
sion model can account for more than X percent of the previously unexplained 
variability of the criterion variable. 
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E« Data Reduction 

This subsection discusses a set of procedures directed toward reducing 
the large pool of project process measures (71) to a smaller number of 
project composites which maintain meaningful information about the process 
attributes of the UB projects. The reason for attempting data reduction at 
this point in the analysis process cone*" i number of measures 

due to the multiple responses called tionnaire items selected. 

Such a large number of available pro;.^. s creates two problems. 

First, analysis with such a large set of measures is very cumbersome. 
Second, since analysis at the project level provides a maximum of 54 cases, 
the number of variables must be kept small to avoid trivial solutions. 
Beyond these analytic problems there are many benefits that derive from 
combining single questionnaire items into composite scale scores. In 
general, the distributions of composite scale values are more tractable and 
stable, and the interpretation of a reduced set of variables is usually 
simpler and less confusing. 

The process variables introduced in subsection I.C provide many candi- 
dates for either a priori scale construction or empirical scale construction 
through factor analysis. The most obvious candidates are questionnaire 
items with more than one subitem, or groups of separate questionnaire items 
that measure attributes of the same UB function. Table 8.9 lists the 
resulting composites derived from the data reduction procedures as applied 
to the variables listed in Table 8.7. In general, the procedure that was 
followed involved the computation of a principal component factor solution 

for each set of variables. Empirical solutions were used if they reproduced 

19/ 

55 percent or more of the variation in the set of variables. — In cases 
where no satisfactory empirical solution was obtained, a priori scale 
composites were used. The a priori composites were derived by grouping 
similar subitems together according to item content and the criteria developed 
in the instrument specifications. In all cases, the final scale composites 
were simple sums of subitems using either positive or negative unit weights. 



— Appendix G describes the factor analysis procedures that were used and 
presents the resulting solutions in more detail. 
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Table 8.9 
PROJECT LEVEL PROCESS COMPOSITES 



a/ 

Variable Class- 


Resulting 
Number of 
Composites 


TvDe of Solution 


Percent ^ , 
Variance^- 


Instructional practices 


3 


EmD ir ical 


55 .5 


c/ 

UB functions— 


14 


iNo Refine ti tail i 




Instructor experience 


2 


Empirical 


70.8 


Counselor experience 


2 


Empirical 


61.6 


Staff ratings of students 


3 


Empirical 


62.2 


Student/staff relations 


3 


Empirical 


76.0 


School cooperation 


2 


A priori 




Philosophy 


3 


A priori 





These classes correspond to those given in Table 8.4. 



— Value given is the percent of variance in the original variables 
accounted for by the principle component factor solution. 

c/ 

— For this variable, no a priori scaling was attempted and the empirical 
solution did not provide interpre table composites. Hence, all 14 subitems 
were maintained. 



398 

8.23 



For all empirical solutions, the weights were applied to the standardized — 
sub items. This technique produces desirable scale properties for the 
composite; the composite will have a mean of 0 and positive and negative 
values of the component may be easily recognized as above average or below 
average, respectively. The results of the factor analyses were used as a 
guide in creating the composites. The factor solutions provided information 
as to which subitems should enter a composite and whether a given subitem 
should carry a positive or negative weight. 

The scaling procedure was on'' rtially successful in significantly 
reducing the number of originr varx , The items dealing with the 

functions of the UB program (PD^ 25, PCQ 20) were not reduced at 

all. The other variables yielded acceptable composites but the total 
number of measures (32) was still rather high. It was felt that attempts 
at further reduction or forcing solutions to a smaller number of composites 
would be counterproductive. While the number of variables would decrease^ 
the interpretability of the solutions and thus the meaningfulness of the 
composite variables would suffer. 

Each set of composites will be briefly introduced below, however. 
Appendix G provides a more complete discussion of these composites. As 
the composites are encountered in later analyses they will be further 
examined. It should be noted that the composites are all computed on 
aggregate data. The level of aggregation depends upon the specific variable 
(see Table 8.7) but in most cases the aggregation was over all three staff 
categories. 

Instructional Practices . This set of three composites was derived 
from question 28 of the PIQ which contained 11 subitems concerning various 
techniques of instruction. Project instructors were asked to rate on a 4~ 
point scale (1 = don't use, 4 - use to a great extent) the extent to which 
they used a given instructional practice. The three derived composites may 
iDe roughly labeled as follows; (1) traditional formal methods, including 

207 

— Standardization of a variable involves subtraction of the mean followed' 
by division by the standard deviation. This sample scale transformation 
yields a variable with a mean of zero and unit standard deviation. The 
standardization of the subitems prior to formation of the composites insured 
that all variables contributing to a component were similarly scaled. 
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lecture, lack of individualized instruction, competitive grading, and non- 
graded classes; (2) nontraditional formal methods , n including programed 
instruction, ability grouping, and noncompetitive grading; and (3) informal 
methods, including open classrooms, instructional media, and seminars. 

UB Functions . All three categories of project staff were asked to 
rank-order the importance, for both summer and academic year, of a set of 
seven project functions. These were: (1) tutoring/remedial instruction, 
(2) counseling, (3) liaison work with schools and community, (4) health 
services, (5) cultural enrichment activities, (6) social activities, and 
(7) parental involvemen^ d iues were derived for each subitem even 

it litems were omitted. cast, of omitted items, the average of the 

unused ranks was assigned to omitted items. Thus 14 scores, 7 average 
summer ratings and 7 average academic year ratings are available for each 
project.' 

Instructor Experience . The instructor experience composites were 
computed by combining several separate PIQ items (11, 13, 14A, 15) that 
dealt with the experience and training of UB instructors. Two composite 
scores were derived from the four items. The composites reflect two aspects 
of experience and can be labeled as follows: (1) teaching expei-^.e'ace 
outside UB, and (2) teaching experience sad inservice training . :in UB. 

Counselor Experience . A set of experience composites was d derived 
for the counselors. These composites are based on six items frcop' the PCQ — 
llA, 12, 13, 14, 15A, airi::^6. They are labeled as follows: (1) i^tical 
counseling experience, and (2) college training in counseling. 

Ratings of UB Students . All project staff were asked to rate students 
on 12 dimensions (PIQ 35, PDQ 34, PCQ 34) . The derived set of composites, in 
which all item weights were positive, reduced the 12 attributes to three 
general scale values: (1) attributes and attention, (2) ability, responsi- 
bility, and independence, xsad (3) creativity and interpersonal relationships. 

Student and Staff Rel^rions * All projeczt staff were asked rto rats 
the quality of the ralatdooships among vario:us groups ^^n.thin the project 
(PDQ 28, PIQ 38, PCQ 32:^ The composites derived for this set of items 
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were based on data aggregated within and across staff categories. Three 
composites, using positive weights, were computed from the set of five 
subitems: (1) staff relationships, (2) student with staff relationships, 
and (3) student with student relationships. 

Staff Philosophy . The project staff members were asked to impose a 
weak ordering on the relative importance of 14 educational goals within 
their own philosophies of education. A set of a priori composites was 
derived for this item defining three scales: (1) development of skills 
and study habits, (2) development of interpersonal skills and self-control, 
and (3) development of achievement motivation and a sense of worth. These 
composites represent the means of t-bj raw values of the selected subitems, 
and thus preserve the original scale. 

High School and Postsecondary School Cooperation > A measure was 
obtained, from staff counselors and instructors, of the quality of the 
cooperation between the UB project and various educational institutions 
(PCQ 33A, PIQ 39A) . This qiuestion consisted of six items, from which two 
a priori composites were '■-.velcif^: (1) canperation with high schools, 
and (2) cooperation with PSZ iris!ii:tutions. The composites were the means 
of the aggregated raw scots^ respanases to the appropriate subitems, 

II. RELATIONTi-i^'P OF PROCESS VARIABLES TO 
STUDENT OUroaMB';- DISCRIMINANT ANALYSES 

Tl2e basic question o^44ressed by this chapter involves possible asso- 
ciations between UB proce^?s measures and student outcomes. This question is 
explored in the current axid following sec1d.ons. The initial approach, taken 
in this section, is that v^f nmiicxple discriminant analysis^ while in Section 
III multiple regression anal-y^ls is used. As previously s^ted, discrimi- 
nant analysis is a techni-ilVii wbiereby known groups are maxis::ally differ- 
entiated along one or mor^^- iiisenElons defined by independent linear combinations 
of a set of discriminator var:::3ax3j.es. 

One set of a priori project (groupings, based on established project 
characteristics,, was defined in. nie previous section. Another approach 
to defining groupings of the prrojects is empirical clustering of the projects 
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selected sets of project measures. For the a priori clusters, a single 
measure defined a clustering of projects and six sets of clusters were 
obtained. The empirical clustering technique operates in a multidimensional 
framework by considering more than one variable at a time. Two sets of 
clusters were obtained (see below) by clustering on two different sets of 
outcome measures. The clusters were defined in terms of output measures 
instead of process measures for several reasons. The set of output measures 
is small, contains measures with the best data availability rates, and 
contains the most accurately measured and stable data (i.e., student data), ; 
The output measures can all be considered as performance measures and are 
similar while the process measures are a very diverse set. Clearly the 
process measures do not lend themselves to a simple categorization, and the 
clusters derived from them would probably not be simply interpretable. 
Finally, the a priori clusters which will also be used are related to the 
process measures and cover some of the same information. 

The approach to discrimination suggested by these two sets of groupings 
is, therefore, quite different. Since the a priori project classifications 
involve characteristics of the project or the students in the project, the 
suggested discriminator variables are the student outcome measures. Con- 
versely, since the empirical clusters are based on student outcomes, the 
appropriate discriminator variables are the project process measures. 
Although the cases will be treated separately, the establishment of a 
strong discrimination among groups by either of these two approaches would 
suggest a relationship between process and output. 

Although some data were collected from 54 UB projects, the maximum 
number contributing to any of the discriminant analyses is 52. One project 
was eliminated because it had no students at the time of the survey, .and 
another project was eliminated because it had no seniors (and thus no 
measures of PSE entry) . All but one of the analyses are performed on data 
from less than 52 projects, however. The additional loss of projects is 
due to two factors: (a) for both a priori and empirical clusters, some 
groups contain so few projects that they were not considered; and (b) for 
analyses involving empirical clusters, some projects lack data on one or 
more of the project process variables in the discriminator variable set. 
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Since these analyses are exploratory, no attempt was made to resolve the 
loss of projects by data imputation or combinations of groups of projects. 
The minimum number of projects contributing to any discriminant analysis 
was 45, representing a 17 percent loss in analysis units from the 
original 54. 

The large number of variables in each of the full sets of discrimi- 

. 21/ 

nator variables precluded the use of a full-model discriminant analysis. — 
Stepwise analysis was therefore used as an initial approach. In stepwise 
discriminant analysis, variables are added and deleted from the discrimi- 
nant function, one at a time, on the basis of predetermined criteria. This 
addition and deletion terminates when none of the variables included in the 
discriminant function at that step meet the criterion for removal and none 
of the variables not included in the discriminant function meet the criterion 
for inclusion. 

For all discriminant analyses; conducted, the first step involved a 

forcing of all project: input variables into the discriminant function, to 

control for the effect of these measures in distinguishing the project 

groups. After the first step, no additional constraints were placed on the 

solution other than the specified criteria for inclusion or exclusion from 

the function. This means that any input variable meeting the exclusion 

criterion could be removed from the final discriminant solution. 

The criteria used for addition and deletion of variables from the 

22/ 

solution was stated in terms of the partial F values — for each variable 
at a given sta^e of the sequential solution. A variable previously in— X. ..,^ 
eluded in the function was deleted if the par:t:ial F value dropped below 
1.0, and a variable not included in the equation was added if tiie partial F 
value was greater than 2.0. When several variables met the criteria for 
removal or inclusion at a given step, the following decision rules prevailed: 
(a) deletion of a variable always took precedence over addition of a variable 



21/ 

— A full-model analysis would include all discriminator var±ables 
simultaneously, and since the total number of ^rariables approaches the 
number of projecrtrs^ trivial solutions would be quite likely. 

22/ 

— The partictl. F value for a variable is an index of the degree of dis- 
crimination thscr is unique to that variable after the discrimination of 
other variables in the discriminant function has been taken into consid- 
eration (i.e., rcesidual discrimination). 
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(b) when two or more candidates for deletion existed, the variable wi*:h the 
smallest partial F value was deleted; (c) when two or more candidates for 
addition existed, the variable with the largest partial F value was added. 

Due to the very large number of discriminator variables relative to 
the total number of projects and the considerable latitude in selecting a 
best-fitting discriminant function provided by the stepwise approach, 
additional criteria were applied to specify the acceptability of a dis- 
criminant solution. A solution was defined as acceptable if both of the 
following conditions were met: (a) the number of project yLua^Lj variabxuo 
p^neri:3;g rhe soluzion wcas greater than the number of projects in the 
smallesc group, and (b) the mimier of projects, incorrectly classified as 
to group membership, as a result of the analysis, was less than half of 
the number that would he incorrectly classified by the "b^est" prediction 
based only on the knoxaLLedge of the sizes of .tiie groups.—^ The results 
of analyses which did aot meet these criteria will not be reported. 

A.. Discrimination Among A Priori Project Groupings 

A priori project measures provided six separate groupings of projects, 
each group consisting of from two to five groups of projects (see Table 
8.8). Eliminating groups containing less than five projects, the group 
means on each, of the 15 discriminator variables (8 characteristics of 
students in the project: and 7 student outcome Eseasures) are presented in 
Table 8.10. .While an examination of group differences for the means of the 
individual variates does not necessarily reflect the potential success of 
the multivariate discriminartt solution, the marked similarity of the. group 
profiles for a particular classification dimension (as indicated in Table 
8.10) does signal a high potential for failure. (If there is no discrimi- 
nation among groups by any of the variables of the discriminator set, then 



— For example, in the two-group case with 40 projects in group A and 
10 projects in group B, the besr prediction of group membership with no 
other information weald be to classify all projects as being in group A. 
This classd.f ication -^yould yield only 10 projects as misclassif ications . 
In that caise, an acceptable discriminant solution would be required to 
correctly jrlassify at least 45 projects • 
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there exists no linear combination of those variables that will distinguish 
among the groups) . 

There were, in fact, no sol ' the six discriml nalyse 

performed on these data that met lIu-. . ; iteria for an .acceptable" 
solution. Thfi solutions were, in fact, unacceptable from an entirely 
different perspective. In over half of the solutions, the only variables 
included in the final discriminant model were the control variables related 
to student preprocess characteristics. This suggests that there is, at 
best, a very weak relationship between whatever UB processes are reflected 
in the a priori classification of these projects and the student outcome 
variables considered here, after accounting for relationships with other 
student characteristics. In light of the failure to obtain acceptable 
solutions, given the latitude allowed by the stepwise approach, no addi- 
tional attempts to analyze these data with rational models were attempted. 

B, Discrimination Amon^ Euipirical Project Groupings Based on Three 
Outcome Measures 

In this subsection the UB process measures will be examined for their 
ability to account for the different profiles of performance revealed by 
one of the empirical cluster solutions. The cluster solution was based on 
three outcome measures: (1) change in academic GPA; (2) proportion of 
twelfth graders entering PSE; and (3) change in proportion of attempted • - 
academic courses. (Fall-to-fall HS continuance/completion rate was not 
used because of the limited variability of this measure over projects.) 
Given the large set of process measures available and the need to consider 
and adjust for differences on the preprocess measures the initial analyses 
of these data vere performed through stepwise, multiple discriminant analysis 
1. The :groject Clusters 

The empirical cluster solution repocrted here separated the 
projects into seven groups on the basxs of output measures that allowed 
classification of more effective and Less effective projects. One 
resulting group consisted of only one project and was eliminated from 
further analysis. Table 8.11 presents the standardized and raw cluster 
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Table 8.11 



RAW AND STANDARDIZED CLUSTER MEANS FOR CLUSTERING 
SOLUTION BASED ON THREE OUTCOME IffiASURES 



Variable 




Cluster 


A B C D E F 


PSE Entry Rate 
for 12th Graders 


Raw 


-1.05 0.53 0.17 0.66 0.58 -2.00 
0.42 0.73 0.66 0.76 0.74 0.24 


Change in 
Academic GPAi:/ 


Raw 


-0.16 0.80 -0.51 -1.31 0.34 0.27 
-0.03 0.19 -0.10 -0.28 0.09 0.07 


Change in Academic 
Course Load~^ 


Raw 


-0.57 -0.77 -0.66 0.81 0.78 1.11 
-0.10 -0.12 -0.11 0.04 0.03 0.06 


Number of Projects 




9 11 8 9 10 5 


NOTE: These values 


are bas 


sed on a total of 52 projects. Two projects were 



eliiip\nated — one because it had no students, the other because it defined 



its own outlying group. 

a/ 

— Change is computed from ninth grade to current grade. 

— ^ These are cluster averages of standardized values, computed by subtracting 

the grand mean from, each observation and dividing by the standard deviation. 
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means for the outcome measures for each of the remaining six project 
groupings. The means of standardized variables, reported in Table 
8.11, allow comparison across variables since all variables have been 
transformed to a similar scale. The standardized values express the 
distance of the cluster mean, in standard deviation units, from the 
grand mean over projects. The sign of the cluster mean indicates 
whether it is greater or less than the grand mean. While the means of 
standardized measures allow cross-variable comparisons, they may be 
misleading when making within-variable comparisons. The standardized 
means reflect only relative variability within a measure, and raw 
cluster means are necessary to establish absolute variability. While 
there is reasonable absolute variability among clusters for PSE entry 
rate, it can be seen from Table 8.11 that the absolute between-cluster 
variability for the academic change measures is not great.— ^ 

The examination of results presented in Table 8.8 indicates that 
the clustering has divided the projects into distinct groups. Project 
clusters can be labeled as more effective or less effective by consid- 
ering the cluster means on each of the three outcome measures. 

25/ 

Three project clusters (B, D, and E) have large (greater than .50) 
standardized cluster means for' PSE entry rate and at least one other 
outcome measure. These clusters can be labeled as the "more effec- 
tive", proj ect clusters. The remaining project clusters do not show as 
consistent a pattern. Clusters A and F have large negative standardized 



24/ ^ f 

For example, the standardized cluster means for change in academic 
course load range from .8 standard deviations below the grand mean to 
1.1 standard deviations above. This difference of almost 2 standard 
deviation units represents only a small difference in terms of actual 
increase in proportion -of academic courses taken. The lower and upper 
extreme cluster were characterized by students who, from ninth grade to 
current grade, attempted 12 perccni: fewer academic credits and 6 percent 
more academic credits, respectively. Such a small difference probably 
has little practical importance. 

25/ ^ . . ^ , 

^ bxaminxng the cluster means one at a time loses some of the multi- 
variate information used by the clustering process but it allows easier 
interpretation of the results. 
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mean values for PSE entry rate and Cluster C has large negative values 
for both the change in grade point average and change in proportion of 
academic courses attempted. While this group of three clusters is not 
as homogeneous as those labeled more effective, they are in general, 
"less effective" than the other clusters. 

Beyond this dichotomy of more effective and less effective clus- 
ters of projects, the pattern of scores of various outcome measures by 
clusters is of interest. Figure 8.1 displays graphically the stand- 
ardized data from Table 8, 11, The three more effective project clus- 
ters (B, D, and E) all show above average and similar PSE rates but 
vary in their performance on the remaining outcome variables. Only 
Cluster E is above average on all three outcome measures. The less 
effective project clusters (A, C, and F) show a wider pattern of 
variation but remain consistently at or below average for two of the 
three outcomes. Only one cluster of projects in this group. A, is 
consistently below average on all three outcome measures. Two project 
clusters, A, the least effective, and E, the most effective, show 
large and consistent differences in outcomes. The remaining clusters 
show less consistent patterns but are distinctly different from one 
another. 

2. Discrimination Among^ Clusters 

Table 8.12 presents ::he set of variables selected in the stepwise 
discriminant process that best separates the clusters based on the 
three outcome measures — PSE entry rate, change in GPA, and change in 
academic course load. This table presents the cluster means of the 
raw and standard scores for. these variables. Additionally, each 
variable has been assigned a discriminability rank, which may be 
interpreted, as an index of the degree of discrimination that is unique 
to a given variable after partialing out the discrimination of the 
other variables. A rank of 1 indicates the variable with the most 
unique discriminating power and a rank of 7 indicates the least. As 
indicated in the final two rows of the tables, not all of the projects 
used to determine the clusters were used in the discriminant analysis; 
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Table 8.12 

CLUSTER MEANS FOR VARIABLES SELECTED IN DISCRIMINANT 
ANALYSES OF THE OUTCOME MEASURE CLUSTERS 



Variable 


Discrimi- 
nability 
Rank^^ 




A 


B 


c 


D 


E 


F 


Project Size 


1 


Std^/ 




u • uu 




1. 06 


-0.21 


-0.92 






Raw 


50.56 


63.91 


69.33 


95.11 


57.50 


36.40 


Emphasis placed on aca- 
demic year training and 
remedial instruction 


2 


std^/ 

Raw 


-0.47 
6.57 


6.82 


1 .11 


U • // 
7.77 


0 . 34 
7.39 


-1.18 
7.85 


Emphasis placed on aca- 
demic year medical 
services 


3 


Raw 


0.41 
3.86 


3.39 


3.30 


O 07 

3.72 


-U . 38 
3.07 


-0. 34 
3.11 


Proportion of project 
students labeled poor 


. 4 


StdV 
Raw 


-0.44 
0.67 


0.50 
0.80 


0.29 
0.77 


-0.22 
0.70 


0.00 
0.73 


-0.52 
0.66 


Propoxw^->a of courses 
attempted that were 
academic 


5 


Std^-/ 
Raw 


0.12 
0.67 


0.41 
0.69 


0.30 
0.69 


-0.03 
0.66 


-0.37 
0.64 


-1.13 
0.58 


Ninth grade GPA 


6 


Std^-/ 


-0.54 


0.46 


-0.42 


0.66 


0.23 


-1.04 






Raw 


4.85 


5.12 


4.88 


5.17 


5.06 


4.72 


Proportion of project 
that is male 


7 


std^/ 

Raw 


0.62 
0.52 


-0.40 
0.39 


-0.27 
0.41 


0.27 
0.48 


0.08 
0.46 


-0.42 
0.39 


Number of projects in 
the cluster 






9 


11 


8 


9 


10 


5 


Number of projects in 
the discriminant analysis 






8 


10 


8 


9 


8 


4 



— The rank value is determined by the relative amount of explained variance attributabl 
to each variable, when all variables are considered simultaneously. 



— These are cluster averages of standardized values, compuned by subtracting the grand 
mean from each observation and dividing by the standard deviation, 
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this reduction is attributable to unavailable data for the project 
process measures. In this case, five projects were lost. 

The depicted solution suggests that the great bulk of the pre- 
dictable variability in outcome performance comes from preprocess 
differences. Five of the seven variables included in the discriminant 
function are preprocess measures that may reflect student selection 
and project size. The only process variables entering the solution 
are two items dealing with the emphasis placed by the project on (a) 
tutoring and remedial instruction and (b) medical/dental health ser- 
vices or referrals during the academic year program. The scale of 
these items is from 1 - least emphasized to 8 = most emphasized. 

Figure 8.2 displays the average profiles for the effective and 
ineffective projects over these variables. This display of the data 
considers only univariate distinguishability among the clusters while 
the discriminant solution considers the simultaneous discrimination of 
all variables. Hence, in interpreting the simple cluster means, one 
should be aware that better discrimination is available by considering 
differentially weighted linear functions of the data. Given this 
caution the univariate comparisons can serve to point out the broad 
features of the relationships of these variables to project effective- 
ness as defined by the cluster solution. The results indicate that 
student selection factors are differentially associated with program 
effectiveness. 

Comparison of the two averaged profiles in Figure 8,2 reveals 
several points. There is a large difference, 1.04 standard score 
unit's, in the ninth grade academic GPA between the two types of proj- 
ects, the more successful projects being characterized by students 
wich higher CPAs. Additionally, the more effective programs tend to 
be larger and to contain a larger proportion of poor students. Both 
process variables entering the discriminant solutian deal with academic 
year program functions. The more effective projects tend to give more 
than average emphasis to tutoring and remedial instruction and slightly 
less than average emphasis to medical services during the ^icademic 
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Figure 8.2. Profiles of the More Effective and Less Effective Project 
Clusters for the Set of Discriminant Function Variables. 
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year. Reference tc t .^e raw cluster means in Table 8.12 indicates a 
very small absolu& isnge of variation for the medical ser^:ices vari- 
able. The discriiniisation contributed by this variable is over a very 
narrow range and :prcfes^ly of very little practical importas^ize, mere 
is a somewhat widiir Tariation in t.he '^lii:fit.*-r means for the -.tatcr-zrag/ 
^e=*iie4ial instr-jctii-rr; vsirxable. 

^- ^'liu^imination Amc .-^iQ&ari cal Project Grc^^lngs Based on PS^: .lutii^omes 

^second set or :^ct clusters wb.s derived by analyzing on. these 
outcome measures relates ..::s^ ?SE entry. This set of output variai. -i; can- 
tains four measures: (:) p^-oportion of twelfth graders entering iSir; (2) 
proportion of PSE entrains enrolling in vocatzinnal/techaical school L:i; (3) 
proportion of psE entrants- -nr oiling in 2-yeHr colleges; and (4) l .opor- 
tion of PSE entrants enrol, ing in 4-year insr:±tutions. This subsection 
examines the nature of the empirical cluster solution, which reflects the 
effectiveness and pattern of student placement in PSE institutions and 
the relationship of project process measures to cluster membership. 
1. The Project Clusters 

The second clustering solution groups the projects by examining 
PSE entry rates and the pattern of entry into various kinds of PSE. 
The obtained solution indicates five basic clusters of projects. The 
five clusters represent only 49 of the 54 sampled projects. One 
project was eliminated because it had no students at the time of the 
survey and another project was eliminated since it had no seniors. 

The three remaining projects were eliminated because they were out- 

26 / 

liers in the obtained cluster solution. — ' Table 8.13 presents cluster 
means of the standardized and raw PSE measures. With the exception of 
Vocational /Technical School placement, the clusters show reasonably 
wide absolute variation in raw mean variables. Examination of this 
cluster solution reveals that there is considerable variation in the PSE 



26/ 

— These three projects form two outlying clusters, one with two members 
and one with a single member. Both clusters showed high PSE rates with 
rather high rates of vocational/technical school placement. 
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RAW ST i-'L , ' ZECli^IILUSTER MEANS FOR CLUSXEE-;^^- 



SOLUTI 


J;oL£2 OJ: "^OSTSECONDARY i-IEASURES 


Variable 




Cluster 




H. I J K L 


PSE Entrv Rate^^ 




1 12 0 6^ -1 21 -0.07 -2.04 

T:,,55 0.75 0.39 0.61 0.23 

1^ . 


Vo cational /Technical 

b/ 

School Placement Rate— 


S:. 

\ 


-,;u-i2 -0.34 -0.40 -0.28 0.02 
'l (1D.09 Q.04 0.04 0.05 0.09 


2-Year College 

b/ 

Placement Rate— 


•/ 

Sf - 
R£ 


._06 -0.50 -0.92 2.31 0.43 
:,.17 0.08 0.02 0.53 0.23 


4-Year College 
Placement Rate^^ 


St: 1 
Rav 


0.18 0.71 0.75 -1.51 -1.59 
! 0.75 0.88 0.89 0.34 0.32 


a/ 

Nimber of Cases 




17 17 5 5 5 







NOTE: Only 49 cases are repoxtei here — one project had no students, another 
had no seniors, and thrss projects were labeled as outliers in the 
clustering solution. 



— This rate is computed for rwtliJt^r graders smly, 
— ^ This rate is computed for 1^ suzziants only. 

— ^ These are cluster averages o^ s-sndarized values, computed by subtracting 
the grand mean from each obser^rHnrrLon sad dividing by the standard deviation. 
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entry . rates and the type of PSE placement that occurs. The frve 
clusters are categcjrLzed below. 

Cluster H- avsr^e PSE entry r^es with an average placemesir!: 
paud:ern. 

Cluster I: high PSE entry rates with relatively high placs^it 
in 4-year institutions. 

Cluster J:: lovr PSE entry rates with relatively high placeme^at: 
in 4-year institutions. 

Cluster K: average ESE entry rates with relatively high plscce- 
ment in 2-year institutions. 

Cluster L: very low PSE entry rates with above average plats- 
ment in 2-year institutions. 

A graphic presentation of these data is given in Figure 8.3.. TSie 
figure reveals that the level of variation among clusters for Vnnrt— jnal/ 
Technical School placement is much smaller than for the other measures.—^ 
The figure also shows that Clusters I and J have fairly similar profiles 
with the exception of the very different PSE entry rates. In general, 
these data suggest that the entry rate per se does not determine the 
type of PSE institution in which the UB students enroll. That is, 
project clusters with relatively high as well as relatively low PSE 
entry rattes both show above average proportional placement into 4* 
year institutions. Similarly, placement in 2-year institutions is 
widely spread over projects with similar levels of PSE entry rates. 
The derived clusters do seem to distinguish plausible groups of projects; 
they define a broad set of PSS outcome patterns and provide a tractable 
classification scheme for relating process variables to different 
patterns of PSE placement.. 
2. Df^crimination Among Project Clusters 

A -siecond discriminant analysis was performed based on the pro jeer: 
groupings derived from clustering the PSE entry pattern measures . 
Table 8.14 presents the standardized and raw scores for the variables 
included in this discriminant solution: four preprocess variables and 
two process measures. As seen in this table, two projects were lost 



27/ 



The outlier projects which are not presented did, however, siiow much 



higher proportional placement in vocational/ technical schools. 
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Table 8.14 



CLUSTER izlLJiS FGE V^IIiELES SELECTED ^3 DHSCRIMINA^JT ANALYSES 
OF TtE ?SE OUTCOME MEASEHI CTLZSTERS 



niscr:; 




^ 


Clustar 


Variable ruabil-i 


ty — 




H 




J 


K 


L 


9th Grad£ C?PA 


4 






0.10 
5.03 




-0.88 
4.76 


0.29 
5.08 


-1.12 
4.70 


Propor.ticri of project 
studenrs ::i:iiat were 
acadencLc irtsks 






1 u 1 
I Std5/ 

Saw 


-0-10 
0.46 


Q.L., 


1.11 
0.64 


-0.12 
0.45 


0.94 
0.62 


Proporticzi of project 
in xztn £ :^QP 


3 




; 3td^ 

1 :Raw 


-0.34 
0.41 


0.3Z 

0.2D' 


-0.83 
0.34 


0.69 
0.55 


0.62 
0.54 


Number o± students 
in pro jeer 


1 






-0.13 
59.90 


O.Hf 
89.2^ 


-0.71 
42.60 


-0.25 
56.40 


-0.96 
35.20 


Relationships among 
staff members 


6 






0.18 
0.33 


0.11 
0.21 


-0.03 
-0.05 


0.30 
0.56 


-1.14 
-2.11 


Emphasis upon cultural 
enrichment during the 
academic y^ar 


2 




-Saw i 


0-.20 
4.55 


-0.28 

4,16 


-1.14 
3.40 


0.42 
4.78 


0.59 
4.93 


Number of cases in rhe 


clus 






17 


17 


5 


5 




Number of cases in the 
inant analysis 






16 


15 


5 


4 


; 



The rank valu- detexminec, by rhe x^ative amounts of explaine i 
variance attributsrLle to each var -able, jir^sn all variables are consid=-red 
somultaneously . 

b ./ 

These are zlMz^er ^v^rages or: stHssciaxoi^red values , computed by 
sabtracting toa , ^V f m d, fxcui esrh Gi>S:arTSEi:ion and dividing by the 

sniandard deviat^xon 
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fx::::m the analysis due co missing or izrcetgrmlnate l.uf ormatri.cn re- 
gi2xding the process measures. After szrjusting for the preprocess 
measures, the process measures which entered the dascriairtani: function 
weire (a) a composite 3easure of staff ral^tionships and (b) a measure 
of emphasis of cultural enrichment acji Lvtr-i-ss during th^e academic year 
(scaled from 1 = leasi: emphasized co I = Zicst emphasized) . 

The interpxetaticn of the iiiir;act: of preprvfpces^i a^^easurev^ is 
not difficuJl t but the inclusion c th^s^e ■tuto pgrticulcir process 
measures ca:use;& some confusion. The profiLes of xhe stssadardizsd 
means of tfee discriminant functiiin varf.HbJ.es for che Siire clust^s are 
displayed in Fz^ure 8.4. It is appareni that the scarf relations 
ccsnposite vart^bJie. serves primarily tc separate one cluster (L) from 
tira orher four,. Emphasis on cultural ^srrichment acridities does 
s^arate the clasi:ers and seems t:. be sxLLe to sepsrace A^-year 
placemenn projects (Clusters I and: J wirii relatdveHy low emjmasis) 
from the remaining clxssters (wit:h re lri I v ely high smphasis). The 
meaning of this separation in tsrms of "project prcccr^ssses is another 
question on which the obtained H:alution sheds little light. Consid- 
eration of the range of variatii^r in tfe cluster rav scora maans for 
the process measures (T-afele 8.K-*^, especially the em?}ha£is-or~-culraral- 
enrichment variarile. indicates i onl'^*' a narrow rangie of vaines 
occurs; variation arross such a row band is dif frrclt to interpret 
even though it pr-ovides some stR::..^£:uic:al discriininabill:ty . ISe pre- 
process measures also discrlnaxna::-*^. Dsrween clusters. Frr esasnple;^ 
Cluster I and J .^3 stoth o^^iu^zsjzt^^^z^ br^ relatively inig^ ra^nss nf 
placeipant in 4-yecrr caH^srs., but Clisstsr J has a low overall 
rate of PSE entr^'' wkile L relatively high overall entry rste.^ 
Cluster I, howBver., ihas srarrted. with somewhat of an advantage — higher 
ninth grade CPA's and iiewer academic risks among participants. A 
similar comparison nan^be made for Clusters K and L in regards to 2- 
year college placrement. 

D- Summ;g>ry of Discrl'^nln.^nt Anal.y3j.s Resclts 

It does not sefflR ^tjscjteisg^v^ry 'co atrempt development of a strot^ cast 
for the existence ami impart 3f preprocess ji±f f erences as a resui: of r.ie 
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analysis presented in this section. It would be very surprising to find 
they did not ejci^t. The surprising aspect of all the solutions is the lack 
of a consistent set, or of even a modest number, of process variables in 
the solutions • N^o evidence appears to relate these process measures to 
project outcome:^ vith the exception of the few listed • It may well be that 
the initial preprocess differences in students from project to project are 
sufficiently graat and sufficiently discriminating so as to overpower any 
relationship of process measures to outcomes. 

The only cue chat appears from these results, and it is a faint one, 
is that certain axademic year activities may relate to the outcome measures. 
It may be more meaningful to interpret the appearance of academic year 
variables as indicators of the level of activity of the academic year pro- 
gram. That is, the inclusion of measures of emphasis of academic year 
processes, together with the notable omission of summer processes, may be 
evidence than it :is the level of activity of the academic year prograin , and 
not a specifiic function or process, that discriminates among project clusters. 
Another piece of evidence supporting this logic is the consistent appearance 
of project size 3IS a discriminating measure. Project size (i.e., the 
number of studenns enrolled) was measured in October and it may be that the 
measure re_£Lacts. at least in part, the activity level of the academic year 
program. 

The findinge^ presented here must be tempered by consideration of the 
analytic technique used* The use of stepwise procedures can capitalize on 
chance sample fluctuations in the data and provide solutions that are 
strictly data dependent. It is sound practice to replicate models derived 
from stepwise procedures; sometimes this is possible by using split-half 
techniques, but due to limited data this is not possible here. These 
results should not, therefore, be considered as presenting final models but 
as providing initial hypotheses which may be subsequently pursued. 

In the next section, the relationships of procesF and outcome will be 
further examined in a slightly different light, using the technique of 
multiple regression analysis. In the current section, a multivariate 
examination of the outcomes was undertaken. By examining the set of outcome 
measures simultaneously the analysis is more sensitive to patterns and 
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interactions among the outcomes, while in section III the outcome variables 
will be examined one at a time. Although the regression approach loses 
some of the appeal of multivariate consideration of the outcome measures, 
it gains by the sensitivity and flexibility with which it examines the 
relationships of the single outcome measure to the process variables. In 
the regression procedures a more detailed analysis can be accomplished by 
going beyond the simple relation of cluster membership to process variables 
that has been examined here. 

III. RELATIONSHIP OP PROCESS VARIABLES TO STUDENT 
OUTCOMES: REGRESSION ANALYSES 

A number of multiple regression analyses were conducted to determine 
if the variation in the separate project outcomes could be explained by 
variations in project characteristics and processes, after controlling for 
project input. The project level outcome variables examined in the regres- 
sion analyses were: average change in academic GPA, average change in 
academic course load, percent entering PSE institutions , percent enrolling 
in 4-year colleges, percent enrolling in 2-year colleges, percent enrolling 
in vocational/ technical schools, and fall-to-fall HS continuance/completion 
rate. As specified previously in this chapter, most of these measures show 
sufficient variation between projects to function adequately as criterion 
variables. 

There were 54 projects sampled in the study, and most of these proj- 
ects provided available data for all of the outcome and predictor vari- 
ables. None of the analyses, however^ are based on more than 50 projects. 
Two projects were dropped from the analyses due to a lack of students or a 
lack of twelfth graders as previously discussed. Other projects were 
dropped when variables in the predictor set were missing. In some of the 
reported analyses, missing data were imputed by regression procedures for a 
few independent variables. In such cases, the imputed value was the value 
predicted by a regression equation derived for projects with no missing 
data. These imputations were made in order to prevent further deterioration 
of the data base. 
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Since many variables were candidates for the regression equations, the 
first set of anal^^ses employed stepwise procedures. The stepwise regres- 
sion involved entering a fixed set of project input variables (percent 
academic risk, percent poverty status, and percent male). These three 
project input variables were expected to relate to the various outcome 
variables in differing degrees as well as to project process variables, 
as suggested by the results of the discriminant analyses reported in the 
previous section. Thus, they were considered as control variables to be 
entered initially into all stepwise regressions and to be presented in the 
final stepwise solution. The function served by these control variables 
was to adjust the UB process variables for differences among projects in 
student inputs. The remaining process and preprocess variables were then 
allowed to enter the regression equation in a stepwise manner. 

The particular stepwise procedure used empirically selects independent 
variables that yield a statistically significant (.10 level of significance) 
increment in the regression sum of squares above that already obtained due 
to variables previously entered in the model. At each step, variables 
previously entered (except for the three control variables) are also checked 
for significance at the .10 level and are dropped from the model if they no 
longer reach this level. When no variable remains that significantly 
increments the regression sum of squares, the procedure terminates* Each 
of the seven outcome variables was regressed on the three fixed project 
input variables and then on whatever subset of the 36 additional process or 
input variables that could be added to these three fixed variables in the 
stepwise procedure. These additional 36 variables are the project level 
composites discussed earlier in this chap:er. 

A choice had to be made between applying sampling weights in the 
regression analyses or performing unweighted analyses. Although the 
probability of a project being included in the sample is not constant 
across projects, the project weights are reasonably homogeneous in that no 
extremely high or low project weights exist. The difference in results 
between the two strategies was examined for a number of data sets, and the 
differences in the estimated regression parameters for weighted and unweighted 
analyses were of small practical significance. Most importantly, the 
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substantive interpretations of the weighred and :unweighted regressions were 
identical. 

A logical argiimecit can also be made. £ar us^zig unweighted regression 
analyses. Large proj^ts were selected i:nto the sample with a higher 
probability than small pr'^jects, which is reflectiied in siaalLer sampling 
weights for the larger p: ojects. On tnie other hsnd, larger projects pro- 
vide a greater nximber of students and staif mentis on which to construct 
project level varishles, and therefoiie observatricras from the larger projects 
shoiild be more stable and, for this resaon, shauiai be given greater weight 
relative to observations from small projecrts. Sampling procedure dictates 
the assignment of less weight to ob^xvaotii^ns Srom large projects but the 
data reliability caiasideirations suggest: g:^:ving, more weight to observations 
from large projects. In a very general 5 -use, these two competing demands 

indicate that unweighted analyses may be. nnost appropriate for this data 
*. 28/ - 

set. Xn any event, as previously iiren-t±Loned„ lighted and unweighted 

regression analyses snow^ no practlcmil d±Lff erences . 

Another problem an analyzing data ffrmn. a complex probability sample is 
"that the standard error of any statistii-: is mirch more difficult to estimate 
than when using a simple irandom sampl:^ 13 thm clustering effect in a 
stratified multistage sample increases t:he i^-ariance of an estimate to an 
extent that is not offset by the gaiin ±z efxicdency brought ahout by strati- 
fication, then the standard error of a statistic estimated from the complex 
sample can be considerably larger than -he comparable stamdard error obtained 
from a simple randjom sample of the sanas sfize. It would be expected, however, 
that the clustering ef feat at the. prxri;:ecr level would be Less than the 



28/ 

Technically, i:he situation is as f rrFI cms . The regre^ion parameters for 
an unweighted analysis are estimated as 3 = (X'X)'^-^X'y» and the regression 
parameters for a weighted analysis ar^ estimated as 3 ^ (X'DX)'~"'"X'Dy , where 
X is the n by p observation matrix fcr: the independent variables, y is the 
vector of outcome values, and D is a fiiiiagorBal weighting matrix. For the 
present situation it is suiggested thar two diagonal weighting matrices should 
be considered jointly anad that the prssdisct of these two diagonal matrices 
will be close to a scalissr matrix, al. Thar is, D = D^D^ - al where is a 

diagonal matrix based ispcm sampling wei^lnits and D is a diagonal weighting 
matrix based upon the rsli.ability of tas: measurements. Consequently, 

(X'Dx)"'-^ X 'Dy = a'-^(X'X).aX'y - (X*X)^^^7. 
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clustering effect when the student is the unit of analysis. For some 

selected statistics presented in Chapter 5, the average design effect, 
29/ 

(DEFF) , — using the project as the unit of analysis, is only slightly 
greater than one, suggesting that the standard errors for these estimates 
from the complex study sample is only slightly greater than that for a 
simple random (equally weighted) sample. This does not, however, directly 
imply that -the DEFF for regression parameters is close to one. In order to 
be conservative, an estimated parameter will be considered as significantly 
different from 0 at the .05 level if the significance level based upon 
assumptions of a simple random sample is .025 or less. 

A. Stepwise Solutions 

A summary of each of the seven stepwise regression analyses is presented 

in Table 8.15. This table indicates for each outcome variable: (1) the 

sign of the standard regression weight for each independent variable in the 

final solution (which reflects the sign of the partial correlation of that 

variable to the criterion variable) , (2) the proportion of outcome variance 

in a given outcome measure explained by the three control input variables 

and any other input variable entering the final regression equation (as 

2 

measured by the squared multiple correlation, R ), and the increment in 

proportion of variance accounted for by the stepwise addition of project 

process variables. 

The most predictable outcome measure was f all-to-fall HS continuance/. 

2 

completion rate, yielding a total R of .706. The least predictable out- 
come measure is percent entering 2-year PSE institutions, with a total of 
2 

R of .339. The input variables considered separately yield the highest 
2 

contribution (R = .389) in predicting change in academic course load and 

2 

the lowest contribution in predicting change in academic GPA (R = .049). 

2 

Program variables yield the highest increment in R (.565) to the predic- 
tion of fall-to-fall HS continuance/completion and yield the lowest incre- 
2 

mental R , (.188) to the prediction of change in academic course load. 



— Design effect is the ratio of the variance of the estimate for 
sample design to the variance of the estimate for a simple random sample 
of equivalent size (see Appendix B) . 
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SmiARt OF STEPWISE aEGRESSIOJJ ANALYSES FOR SEVEN PROJECT OUTPUT MEASURES 



Ralacionahlp to ProJ«cC Outpuc K«asur«8 
Iq Final Regreaalon Equation 



Projece Input and Froceaa Measures 



Change Change in rall-to-fall Total 2-Year 4«Ye«r 
in Academic Continuance/ PSE Vocational/ College Collegi 
Academic Course Completion Entry Technical Entry Entry 
Load Race Rate Entry Rate Rate Race 



FrocBfls Measures 



Inacructiooal Practices Used 

Traditional Formal Mechods 
Koncradiciooal Formal Mechods 
Informal. Methods 

Project Emphasis on Functions 

Tutoring/Remedial Inscruccion (Summer). 
Counseling (Summer) 

Liaison Work vlth Schools and Cocnunicy (Summer) 

Health Services* (Summer) 

Culcural Enrlchmenc AcciviCles (Suoaer) 

Social Accivities (Sumaar) 

Parental Involvemenc (Summer) 

Tucoring/Remadial luscruccion. (Academic Tear) 

Counseling (Academic Year) .' 

Liaison Work vich Schools and Communicy (Academic 
Year) 

Health Services (Academic Year) 
Cultural Enrichment Activities (Academic Year) 
Social Accivicies (Academic Year) 
Parencal Involvement (Academic Year) 

Sca£f Experience /Training^^ 

Inscruccor Teaching Experience Oucside UB 
Inscruccor Teaching Experience and Inaervice 
Training Wicb UB 

Scaff Ratings of ua ScudenC3 

Acticudes and AcCenCion 
Abilicy, Kesponsibilicy, and Independence 
Creativity and Interpresonal Relationships 
Intrapro J ec t - Relatiouships 

Amono: Staff 
. Students with Staff 
Among Students 

Staff Ratings of Important Aspects of Education 

Cevelopment of Skills and Study Habits 
Development or Interpersonal Skills and Self 
Control 

Development of Achievement Motivation aad 
Sense cf Worch 

School Cooperation 

High Schools 
FSS Insticucions 

Miscellaneous 

PercenC of Inscructor Tine SpenC Tucorlng 
Prcjocc Size (Number of Parcicipancs) 



(-) 



(«-) 



(-) 



(-) 



(+) 



(+) 



(+) 



(-) 



(-) 
(-) 



(+) (+) 



(-) 



(+) 



(+) 
(+) 



(-) 



(-) 



(-) 



(-) 



(+) 



(-) 
(-) 



(-) 



(+) 



(-) 



(-) 



(-) 



(-) 



(-) 
<+) 



Inpuc Maasurea 



Percenc Hale 
PercenC Poor 
PercenC A.cadamic Risk 
NinCh Grade CPA 

Ninch Grade PercenC Academic Course Load 
PercenC Elevench Graders 
Percenc TvelfCh Graders 



(-) 
(+) 
(-) 



(-) 
(-) 



(+) 
(+) 
(-) 



(-) 
(+) 
(-) 

(+) 



(-) 
(+) 
<+) 



Number of Inpuc Variables Selecced For Final Solution 
Proporcion of Variance Explained by Inpuc Variables 
Number of Process Variables Selecced for Final 
Soluciou 

Proporcion of Variance Explained by Process Variables 
Tocal Proporcion of Variance Explained by Final 
Solution (R ) 



(-) 
(-) 
(+) 



(+) 
(+) 
(-) 



3 

.049 


4 

.389 


3 

.141 


4 

.361 


4 

.151 


3 

.055 


3 

.197 


A 

.524 


4 

.188 


7 

.565 


3 

.219 


5 

.316 


4 

.235 


6 

.403 


.573 


.577 


.706 


.580 


.467 


.339 


.600 



NOTE: All analyses were conducced using 50 projeccj. The firjc chree listed inpuc measures were forced Inco che regres 
sion equacion, and ocher process and inpuc aeasurea vare subsequencly allowed co encer che equacion in a scepwise manner 
^^vl^» shows che signs of che parcial relationships of che variables in each final regression equacion, all variables 
^^n^ ecaled 30 chac direcc relacionships of che conscructs Co che output measure were given by positive relation- 

put variable"'"^ !) equations were characterized as having "significant" partial reiationshipa co the out- 

a/ 

The taeaaures of staff experience or training vi^rc obtained for counselors and directcrn. bur vere noc used in 

Che analyses due to the extent to which the data vere indeterainanc. 
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In general, percent of academic risk students in the project seemed 
the most important o£ the three project input variables in predicting the 
outcome variables; however, this varied from analysis to analysis The only 
preprocess variable, other than the three control variables, entering any 
of the regression equations was the average with grade academic course load 
of project participants. As can be seen in Table 8.15, the pattern of 
project variables entering the seven regression equations was not conceptually 
reasonable; totally different models were selected for the prediction of 
conceptually similar and correlated outcome variables • Moreover, the 
nature of the partial correlations between certain process variables and 
student outcomes does not yield to a simple interpretation. Notice, for 
example, that an emphasis of tutoring and/or remedial instruction during 
the summer program is negatively related to change in academic course load 
from ninth to current grade • This is most difficult to explain in terms of 
an "effect" of this UB activity on the student outcome • A more reasonable 
interpretation of this relationship would be that emphasis on this function 
was needed by those projects serving students who had decreased their 
academic course load and that such an emphasis was less needed by projects 
serving students who had maintained or increased their academic course 
load. The only process variables showing only positive partial relationships 
with one or more outcome measures are emphasis of parental involvement (in 
summer and academic year program) , emphasis of tutoring and/or remedial 
instruction during the academic year, and" relationships between students 
and staff. 

It should be kept in mind that the stepwise procedure, based on 50 
projects, was allowed to select the best set from 36 project variables and 
hence the stepwise regression process coull easily be capitalizing on 
sampling fluctuations in the correlation matrix. Stepwise solutions 
should always be viewed with caution unless they have been cross-validated 
on another independent sample to determine if the results are stable. The 
sample of 50 projects' is not large enough to allow such a cross-validation 
study by split-half techniques. The stepwise regressions do indicate, 
however, that some process variables enter the stepwise regression equa- 
tions in varying degrees and patterns, and that relationships do, therefore, 
exist between process and student outcomes for this sample of projects. 

8.52 



Rational Model Testing 

Further reflection on the results of the stepwise regressions described 
above and the nature of the UB project variables led to a decision to 
concentrate on testing specific hypotheses concerning the fall-to-fall HS 
continuance, percent entering postsecondary institutions, and percent 
entering 4-year colleges. . Each resulting model contained the three 3tudent 
input aggregates and a measure of project size. . Since these four variables 
are related to both project process variables and project outcome variables, 
they can be considered as control variables in each of the regression 
models designed to test specific hypotheses concerning the effect of UB 
program variables. The instructional practices and UB function variables 
attempt to measure various aspects of potential differences in the UB 
processes. The remaining project level variables are not considered as 
directly measuring these potentially important program components. (It is 
assumed that factors such as instructor or counselor experience would have 
only indirect effects operating through the UB program strategies that they 
chose to pursue.) 

1. Instructional Practices 

The first set of. hypotheses to be tested through regression 
models concerns the null hypotheses that the three dimensions 
of instructional practices have no effect on fall-to-fall continuance, 
entry into PSE, or entry into a 4-year college, when controlling for 
the three student input variables and project size. The results of 
the three regression analyses are presented in Tables 8.16 to 8.18. 

Referring to Tables 8.16 through 8.18, it' can be seen that the 
instructional practice factors do not significantly contribute to any 
of the three regression models. Percent academic risk is a statisti- 
cally significant predictor of overall postsecondary entrance rate, 

and project size is significant in predicting 4-year college entrance 
30/ 

rate. In each of the models, student input variables and project 

size account for most of the regression sum of squares. Fall-to-fall 
HS continuance is associated with the smallest total R^, which could 



30/ 

— Recall that the reported level of statistical significance is double 
that obtained assuming a simple random sample. 
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POSTSECONDARY ENTRY RATTTHj-GHESSED ON THREE PROJECT INPUT VAIU^BLES, 
PROJECT SIZE, AJCTTHSEE INSTRUCTIONAL PRACTICE FACTORS 



Source of Varlaclon 


Correlacion 
wich Pose* 
secondary 


Regression 
Sua of Squares 


Scandardized 
PaTci^l 
Regression 


Sig;nif icance 
i^e ve A 












Percenc Male 


-.073 


.0107 




-.1272 


NS 


Parcenc Poor 

Percenc Academic Risk 


.111 
-.501 


.0217 , 
.4889 * 


.6326 


-.0338 
-.4330 


NS 
.01 


Project Size 


.402 


.1113 




.2684 


^;s 


Tradicional Formal Mechods 


.157 


.0000 




-.0063 


NS 


Nontradiciooal Formal 
Mechods 


-.084 


.0089 


.0097 


.0637 


NS 


Informal Mechods 


.038 


.0008 




.0211 


NS 


Tocal Regression 




.6423 






Tocal Correc::ed Variacion 




1.9782 







NOTE: This analysis vas performed for 52 projects and yielded a total R of .3246. 



— The significance level reported is double the significance obtained assuming a 
simple random sample. 



Table 3.17 

FALL-TO-FALL HS CONTINUANCE /completion RATE REGRESSED ON THREE PROJECT 
INPUT VARIABLES, PROJECT SIZE, AND THREE INSTRUCTIONAL PRACTICE FACTORS 



Source of Variation 


Zero-Order 
Correlation 

with 
Fall-to-fall 
Continuance 

Rate 


Regression 
Scm of Squares 


Standardized 
Partial 
Regression 
Coefficients 


Significance 
Level^'^ 


Percent Male 


.088 


.0031 




.0712 


NS 


Percent Pooi: . 
Percent Academic Risk 


.072 
-.373 


.0026 
.0504 


.0659 


.0308 
-.2650 


NS 

:;s 


Project Size 


.286 


.0098 




.1405 


NS 


Traditional Formal Methods 


.060 


.0001 




.0037 


NS 


Non traditional Formal 
Methods 


-.284 


.0149 


.0150 


.2026 


NS 


Informal Methods 


-.084 


.0000 i 




-.0120 


NS 


Total Regression 




.Oao9 






Total Corrected Variation 




.3925 







NOTE: This analysis was performed for 52 projects and yielded a total r"^ of .2063. 



— The significance level reported is double the significance obtained assuming a 
simple random sample. 
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Table 8.18 

J?^?rL^ COLLEGE ENROLLMENT RATE REGRESSED ON THREE PROJECT INPUT 
VARIABLES, PROJECT SIZE, AND THREE INSTRUCTIONAL PRACTICE FACTORS 



Source of Variation 


^eto— vraer 
Correlation 

rVXUii ^ 

Year College 
£<nL ranee 
Rate 


Regression 
Sum of Squares 


Standardized 
Partial 
Regression 
Coefficients 


Significance 
Level-^ 


Percent Male 


• Kfy A. 


.0190 




.0581 


NS 


Percent Poor • 


.097 


.0256 


» .7463 


-.0153 


NS 


Percent Academic Risk 


-.393 


.3220 


-.2314 


NS 


Project Size 


.524 


.3797 ^ 




.4401 


01 


Traditional Formal Methods 


.161 


.0023 




.0260 


NS ! 


Nontraditional Formal 
Methods 


-.065 


.01Q2 1 


.0443 


.0250 


NS 


Informal Methods 




.0318 i 




. .1260 


NS 


Total Regression 




.7906 






Total Corrected Variation 




2.3037 







SOIE: This analysis »as performed for 52 projects and yielded a total of .3431. 
sLplf r'a^'o^'fi^pu! """"^ '"^ significance obtained assuming a 



6 
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be due in part to the smaller variation in fall-to-fall coatinuance/ 

completion rates across projects relative to postsecondary entrance 

rates and 4-year college enrollment rates. The analyses indicate that 

instructional strategies as defined and measured in this study are not 

significantly related to any of the three outcome variables when 

31/ 

controlling for student input and project size. — These findings 
should not be taken to mean that instructional strategies do not make 
a difference in UB outcomes. Rather they indicate that the instruc- 
tional strategies measured in this study do not capture the variation 
that is predictive of the UB outcomes measured in this study. This 
could be due to inadequate measurement characteristics such as the 
unreliability of data, lack of sufficient variation among projects on 
these measures, or measureraient cf tihe wrong dimensions. 
2. Functions Emphasized . 

Project Sxiaff rank-ordered zzhe emphasis of seven UB project 
functions Sdx cioth the summer and. academic year program. Three of 
these functions for both summer a;nd academic year programs were hypo- 
thesized t3x impact on the r.hree critical outcome variables. These 
functions axe: tutoring/remedial instruction, counseling, and parental 
involvement. There are six measures in all; three for the summer 
program and three for the academic year program. The null hypotheses 
to be tested are that these sdx UB functions have no impact on the 
three outcomes when the three student input variables and project size 
are controlled. The results for the three sets of regression equations 
are presented in Tables 8.19 to 8.21. 

PSE entry rate is the most predictable of the three outcome 

variables from the input, size, and function factors as shown in 

2 

Table 8.19. The R is .499 and the input and size variables con- 
tribute over two-thirds of this explained variance. The function 
variables do, however, add a significant increment to the regression 
sum of squares. The standardized partial regression coefficients for 



31/ 

— The zero-order correlations of the three instructional practices 
factors with each of the three criteria suggest that they are not signifi- 
cantly related even without controlling for student input variables and 
project size. 
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Table 8.19 

POSTSECONDARY ENTRY RATE REGRESSED ON THREE PROJECT INPUT VARIABLES, 
PROJECT SIZE, AND SIX UB FUNCTIONAL EMPHASIS FACTORS 



Source of Variation 


Zero-Order 
, Correlation 
With Post- 
secondary 
Entrance 
Rate 


Regression 
Sum of Squares 


S tandar dizec 
'Partial 
Regression 

Coefficients 


Significance 
Level— 


Percent Male 


-.046 


.0040 ^ 


\ 


-.1638 


NS 


Percent Poor 

Percent Academic Risk 


.174 
1 -.496 


-.0541 
.4242 


■i 
I 

^.6320 

I 


.0348 
-.2810 


NS 
NS 


Project Size 


• 455 


.1496 i 




.1458 


NS 


Tutoring/Remedial Instruc- 
tion (Summer) 


-.090 


.0001 




-.1389 


NS 


Tutoring/Remedial Instruc- 
tion (Academic Year) 


.451 


.1255 




.4493 


.025 


counseling (Summer) 
Counseling (Academic Year) 


-.194 
^.127 


.0179 
.0004 


^.3082 


-.1093 
.0781 


NS 
NS 


, Parental Involvement 
(Summer) 


.292 


.0263 




.0311 


NS 


Parental Involvemant 
(Academic Year) 


.132 


.1380 J 




.3323 


.05 


Total l^&gf ession 




.9400 






Total Corrected Variation 




1.3351 








This analysis »as performed £or 30 projects and yielded a total of .4987 
LpWa^d'o'Sl^pU? ''''' -■'""^ significance obtained assuming a 



NOTE 
a/ 
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tutoring /remedial instruction during the academic year, and parental 

involvement during the academic year are statistically different from 

0 at the .025 and .05 levels, respectively. Both coefficients are 

positive and indicate thar higher emphasis on these two factors is 

associated with a higher PSE enciry rate when other variables in the 

2 

regression equation are held constant. The next largest R (.433) is 
associated with prediction of 4--year college enrollment rate as shown 
in Table 8.20. Parental involvement during the academic year again 
shows a partial association which is significant at the .05 level, and 
tutoring/remedial instruction during the academic year exhibits the 
next largest regression coefficient (although it is not significant at 
the .05 level). Four-year college enrollment rate and overall PSE 
entry rate are correlated .74, axid a similar pattern emerges regarding 
the partial associations of the .two UB function variables to these 
related outcome variables. 

The final regression analysis in this set involves regressing the 
fall-to-fall HS continuance/completion rate on the same set of inde- 
pendent variables. The results of the analysis are reported in Table 
2 

8.21. The R of .285 is the smallest of the three analyses and n£ 
UB function variable showed statistically significant regression 
coefficients. 

The significant findings that were observed in this subsection 
(Tables 8.19 and 8.20) do not necessarily indicate that emphasis on 
these project functions effects a higher level of the outcomes con- 
sidered. It means that there is a partial association between the 
process factors and outcome measures. For example, it could be that 
success of the project could increase parental involvement or that 
parental involvement covaries with some other factor that causes 
projects to have higher PSE entry rates. Another reason why these 
findings should be viewed cautiously is that they are marginally 
significant. Since the data points are still few relative to the 
number of variables, some capitalization on random variation has 
likely occurred. These significant findings do, however, suggest 
areas toward which further research emphasis can be directed. 
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Table 3.20 



FOUR-YEAR COLLEGE ENROLLMENT RA2E REGRESSED ON THREE PSDJECT TNPUT 
VARIABLES, PROJECT SIZE,' AND EEC UB FUNCTIONAL EMPHASIS FACTORS 













Source of Variation 


Zero-Order 
Correlation- 
With 4- 
Year College 
Entrance 
Rate 


Regression 
Sum of Squares 


Standardized 
Partial 
Regression 
Coefficients 


Signif icaycTP! 
Level—' 












Percent Male 


.069 


.0093 




-.0167 


NS 


Percent Poor 

Percent Academic Risk 


.240 
-.416 


.1217 
.2552 


\ .6474 

( 


.0948 
-.2047 


NS 
NS 


Project Size 


.512 


.2612 j 




.2753 


NS 


Tutoring/Remedial Instruc- 
tion (Summer) 


-.069 


.0039 N 




-.0649 


NS 


Tutoring/Remedial Instruc- 
tion (Academic Year) 


.357 


.0312 




.3402 


NS 


Counseling (Summer) 


.049 


.0150 




.Q980 


NS 


Counseling (Academic Year) 


-.047 


.0023 


> .:2:02i 


.0496 


NS 


Paxental Involvement 
(Summer) 


.283 


.0133 




-.0060 


NS 


Parental Involvement 
(Academic Year) 


.182 


.1364/ 




.3240 


.05 


Total Regression 




.8497 






Total Corrected Variation 




1.9605 















NOTE: This analysis was performed for 50 projects and yielded a total R of .4334. 



— The significance level reported is double the significance obtained assuming a 
simple random sample. 
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Table 8.21 



FALL-TO-FALL HS CONTINUANCE/COMPLETION RATE REGRESSED ON THREE PROJECT 
INPUT VARIABLES, PROJECT SIZE, AND SIX UB FUNCTIONAL EMPHASIS FACTORS 



Source of Variation 


Zero-Order 
Correlation 
With Fall- 
to-Fall HS 
Continuance/ 
Completion 
Rate 


Regression 
Sum of Squares 


Standardized 
Partial 
Regression 
Coefficients 


Significance 
Level-' 


Percent Male 


.110 


.0046^ 




.0800 


NS 


Percent Poor 

Percent Academic Risk 


.112 
-.366 


.0060 
.0437 


> .0680 

1 


.0845 
-.3455 


NS 
.05 


Project Size 


.318 


.0137 > 




.2225 


NS 


Tutoring/Remedial Ins true-- 
tion (Summer) 


-.006 


.0006 > 




,1007 


NS 


Tutoring/Remedial Instxuc- 
tion (Academic Year) 


-.013 


.0209 




-.2035 


NS 


Counseling (Suimner) 


.016 


.0000 




.0141 


NS 


Counseling (Academic Year) 


.032 


.0043 


> .0415 


-.0597 


NS 


Parental Involvement 
(Summer) 


.189 


.0040 




.0480 


NS 


Parental Involvement 
(Academic Year) 


.280 


.0117/ 




.2144 


WS 


Total Regression 




.1095 






Total Corrected Variation 




.3845 







NOTE: This analysis was performed for 50 projects and yielded a total R of .2849. 



— The significance level reported is double the significance obtained assuming a 
simple random sample. 
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C. Post Hoc Regression Analyses 

The results of the regression analyses presented in the two previous 
subsections, as well as results of the discriminant analyses presented in 
Section II, suggest that relationships existed between certain project 
process variables and student outcomes. Specific project variables that 
were hypothesized as being related to student outcomes were general activity 
level in the academic year program and parental involvement. A further 
investigation of these hypotheses thus appeared warranted; however, such an 
investigation is clearly conducted in the spirit of a posteriori analysis. 
That is, having decided on the set of process variables to be examined (by 
decision rules based on practical and theoretical consideration), certain 
relationships were uncovered and specific questions raised. The decision 
to further explore the uncovered relationships using other previously 
excluded process variables was, however, strictly guided by the relationship 
that had already been observed. Such investigations are clearly post hoc . 

Item 20 of the PDQ, previously uninvestigated for a relationship to 
student outcomes, provides a measure of the activity level of the project 
during both the summer and the academic year programs. Directors were 
asked to indicate the existence at their project of 32 specific activities 
during summer and academic year programs. These 32 activities were grouped 
into nine major areas and a count of the number of activities offered in 
each major area constituted the measure of activity level for that area. 
The areas were: (1) remedial course offerings, (2) general academic 
course offerings, (3) enrichment course offerings, (4) minority-specific 
course offerings, (5) course offerings in specific skill development, (6) 
tutoring activities, (7) counseling and other helping activities in non- 
academic areas, (8) counseling and other helping activities in academic 
areas, and (9) other activities.—^ 
32/ " 

— The general areas were defined as follows: Remedial Courses , subitems 
^' ^""^ 5; General Academic Courses, subitems 4, 6, 8, and 9; Enrichment 

Courses, subitems 10, 11, and 12; Minority-Specific Courses , sub items 7 

Specxfxc Skill Courses , subitems 13, 14, and 16; Tutoring , subitems 
X/, 15, ly, and 20; Nonacademic Counseling and Help , subitems 21 22 
and 29; A_cademic Counseling ^ and Help , subitems 23, 24, 25, 26, 27 and 28- 

^ubitpf" .^^W ^ Appendix D fo^ specific 

subitem identification. 
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The resultant activity measures were examined for relationships with 
student outcomes, after controlling for project variation on a set of eight 
variables previously observed to exhibit relationships with student out- 
comes (the seven input variables considered in subsection III. A and project 
gi2§) I llie control variables were forced into a regression model and the 
activity level variables were allowed to enter in a stepwise manner as long 
as any remained which were related sufficiently to the outcome measure to 
produce a partial F value of 1.5 or greater. Separate analyses were per- 
formed for summer measures and academic year measures. 

Summaries of these analyses are presented in Tables 8.22 and 8.23 for 
the su^er program and academic year program, respectively. These tables 
show the partial correlations of all variables in the final stepwise regres- 
sion solution with the specific student outcome measure being considered. 
Also shown in the tables are: (1) the proportion of variance in the outcome 
measures accounted for by a regression model including only the control 
variables, and (2) the proportion of variance in the outcome measure accounted 
for by the final stepwise regression solution (including the eight control 
variables and any activity measure that may have entered the equation) . 

Although the analyses were conducted using different subsets of 
projects (due to the fact that some projects had different patterns of 
indeterminate data for summer and academic year measures) , a comparison 
between the two tables is useful. The patterns of partial correlations of 
the control variables to a given student outcome measure are similar, 
regardless of whether academic year or summer program activity levels are 
included in the final stepwise solution. The control variables, as a set, 
are more predictive of some student outcomes than of others, and individual 
control variables are more or less uniquely predictive depending on the 
specific student outcome being considered. These results are in basic 
agreement with other regression analyses involving these variables, as 
reported in previous subsections. 

For the basic outcome measures (HS continuance, change in academic 
GPA, change in academic course load, and PSE entry rate), the gain in 
prediction by addition of academic year activity level measures to the 
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Table 8.22 



SUMMARY OF STEPWISE ANALYSES FOR REGRESSION OF STUDENT OUTCOMES ON , 
MEASURES OF SUMMER PROGRAM ACTIVITY LEVEL IN SPECIrTC FUNCTIONAL AREAS 



Predictor Variables 



Control Varlablea^-^ 



a/ 



Niixch Grade Academic G?A 
Ninth Grade Academic Course 
Load 

Proportica of 11th Graders 
Proportion of 12th graders 
Proportion Male 
Proportion Poor 
Proportion Academic Risk 
Project Size 

Functional Area^^ 



Remedial Courses 
General Academic Courses 
Eorlchment Courses 
Minority Specific Courses 
Skill Improvement Courses 
Tutoring 

Counseling and Other Help 

(>*onacadeTiic) 
Counseling and Other Haip 

(Academic) 
Othar Accivitiss 



Student Outcome I'leasures 



2-Year 4-Year 

Fail-co- Change in Change in Vocational/ College College 

Fall as Academic Aicadeattc Total PSE Technical Entry Entry 
Continuance CPA Coursfc Xaad Entry Rate Entry Rate Rate Rate* 



.12 


.08 




.27 


-.07 


.03 


.08 


.06 


-.16 


— .OBi 


.45 - 


.20 


-.02 


.13 


-.09 


.01 ' 


-. 


-.34 


-.08 


.04 


-.07 


-.01 


.23 


.21 


-.21 


.16 


.02 


-.21 


.14 


-.01 


.22 


.04 


-.34 


.16 


.24 


.18 


.28 


-.34 


-.06 


-.17 


-.04 


.18 


-.01 


-.07 


-.05 


.13 


.06 


-.10 


.07 


.13 


-.54 


.00 


.40 


.02 


-.20 


.29 










-.22 


-.31 






-.32 




-.34 










,39 








-.23 












-.45 


.37 





-.22 



.37. 



.30 



.38 



Proportion of variance in depen- 
dent variable accounted for by 
a model including only the con- 
trol variables 

Proportion of variance in depen- 
dent variable accounted for by 
the final stepwise regression 
model 



.218 



.25^ 



.418 



.530 



.472 



.573 



^^77 



.536 



.163 



.380 



.076 



.259 



267 



267 



NOTE 
var: 

enterec 




e available on all 
variable, which vas 



- These variables were forced into whe regression equation prior to examining any contribution to regres- 
sion by the activity levels In the functional areas. 

These measures vere computed from responses to item 22 or -he PDQ and reflect the number of specific 
activities offered by the project in each of the listed generax areas. 



EKLC 



438 



8.63 



Table 8.23 

'^!r°i4Tf v^'i -^^'^ REGRESSION OF STTOEOT OUTCOMES ON MEASURES 
OF ACADEMIC YEAR PROGFAM ACXmiY LEVEI. IN SPECIFIC FUNCTIONAI, AREAS 



Predictor Variabl es 



Student Ovttcome Measnres 



Fall-to- 
Fall HS 
Contlntiaace 



Change la 
Acadesilc 
GPA 



2-Year 4-Year 
Change in Vocational/ College College 

Acadeaic Total PSE Technical Entry Entry 
Course Load Entry Rate Entry Hate Rate Rate 



Control Variableg^ -^ 

Ninth Grade Acadeaic G?A 
Mlnch Grade Academic Course 
Load 

Proportion of 11th Graders 
Proportion of 12th graders 
Proportion Male 
' Proportion Poor 
Proportion Academic Risk 
Project Size 

Functional Area^^ 



Hemedial Courses 
General Academic Courses 
Enrichment Courses 
Minority Specific Courses 
Skill Improvement Courses 
Tutoring 

Counseling and Other Help 

(Nonacademic) 
Counseling and Other Help 

(Academic) 
Other Activities 



Proportion of variance in depen- 
dant variable accounted for by 
a model including only the con- 
trol variable 

Proportion of variance in depen- 
dent variable accounted for by 
the final steprrtsa regression 
model 



.07 

.13 
.05 
.06 
-10 
.17 
.02 
.18 



-.26 

.15 
.16 
.48 
-.24 
.18 
-.21 
-.38 



.23 
.55 
.39 

.44 



.19 


.32 


-.05 


.03 


.01 


-.66 


.44 


.18 


-.07 


.19 


.06 


-.41 


-.18 


.15 


-.05 


.24 


-.21 


-.24 


.21 


-.11 


.27 


.12 


-.18 


-.04 


.31 


-.35 


.11 


.08 


-.11 


.16 


-.01 


.16 


-.06 


-.02 


.06 


00 


.13 


-.32 


-.10 


.43 



.26 



.32 
.22 
.24 



.29 
-.21 



.25 



.22 



.206 



.288 



.407 



.661 



.479 



.526 



.464 



.622 



.225 



.225 



.074 



.074 



267 



.331 



Thesa measures were computed from responses to item 22 of the Pno anrf ^=.fio^r -u u ^ 
accivicies offered by the project in each of the lis t^general areas/ °' 
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regression model is generally greater than for summer activity measures. 
Relatedly, more of the academic year measures enter into the final stepwise 
solutions. For those student outcomes pertaining to pattern of PSE place- 
ment, the picture is somewhat different. Academic year activity level 
variables marginally increase predictability of 4-year college placement, 
while summer activity level variables substantially increase predictability 
of vocational/technical school and 2-year college placement. 

The results of these analyses do not provide a consistent or stable 
picture of relationships between program activity level in specific areas 
and the student outcomes. Some regression models are quite reasonable, 
while others are much less reasonable. As an example, consider the results 
for PSE entry rate. The stepwise solution for the academic year activity 
yields an increase of 16 percentage points in predictable variance of PSE 
entry over that accounted for by the control variables. Moreover, the 
partial relationships between the activity level measures and PSE entry 
rate are positive ind reasonable. Holding input and project size constant, 
greater levels of academic year activity in the areas of remedial course 
work, enrichment courses, and specific skill development courses are related 
to higher PSE entry rates. On the other hand, the addition of summer 
activity measures raises the predictable proportion of variance in PSE 
entry by only about 6 percent. The one activity level measure included in 
the stepwise solution is general academic course offering and the sign of 
the partial correlation is negative. This suggests that greater levels of 
summer program activity in the area of general academic courses is related 
to lower levels of PSE entry, controlling for project input and size 
differences. 

It should be recalled that stepwise methods are quite subject to 
chance data fluctuations and that these analyses were post hoc analyses. 
Also, as previously indicated, the entry of these measures into the multiple 
regression model was facilitated by an extremely generous inclusion rule 
criterion. In general, however, these analyses do lend support to the 
hypothesis that academic year level is positively related to the basic 
student outcomes. 

Two items of the PDQ provided data allowing a further investigation of 
the hypothesized relationship between parental and community involvement 
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and student outcomes. Item 25 of the questionnaire solicited the directors' 
evaluation of the effectiveness of activities performed by parents and 
community groups; item 27 requested ratings of the support which the project 
received from parents as well as from other groups and agencies. Stepwise 
regression analyses were performed for each questionnaire item separately 
and the results of these analyses for each of the student outcome u:easures 
are summarized in Tables 8.24 and 8.25. These anal>ses were performed in 
a manner analogous to that described for the previous analyses of activity 
level measures, and the tables present the same type of summary information. 

From Table 8.24 it can be seen that the rated effectiveness of functions 
performed by parents and community groups entered the stepwise solutions 
for only five of the student outcome measures. Increase of explained 
variance in the student outcomes by including the function-effectiveness 
measures was not substantial except for 4-year college placement, and in 
that case the signs of the partial correlations lead to some confusion in 
reasonable interpretation. The results presented in Table 8.25 indicate 
that the level of support from students' families is not related to any of 
the student outcome measures when controlling for project input and size. 
The post hoc analyses do not , therefore, support the hypothesis that 
parental involvement is related to student outcomes. 

IV. SUMMARY 

The purpose of this chapter was an exploration of possible relation- 
ships of project characteristics and project outcomes. The approach used 
reflects an hypothesis-generating philosophy — examining the available 
sample data for patterns of relationships and using obtained results to 
generate hypotheses that may be subject to test in later studies. Three 
sets of variables were available for analysis. They were preprocess measures 
(e.g., student grades, student poverty status), process measures (e.g., 
staff characteristics, project functions, type of project instruction), and 
outcome measures (e.g., PSE entry rate, change in GPA, type of PSE entered). 
Variables within each class were aggregated over students or staff members, 
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Table 8.24 

SU^iMARY OF STEPWISE AZULYSES FOR REGRESSION OF STUDENT OUTCOMES ON EFFECTIVENESS 
OF FUNCTIONS PERFOKMED 3Y P.\RENTS AFO COMMUNITY GROUPS 



Predictor Variables 



Student OuccQiae Measures 



2-Year 4-Year 

Fall-to- Chani?^! in Change in Vocational/ College College 

.. . FallHS Academic Academic Total PSE Technical Entry Entry 
Continuance CPA Course Load Entry Rate Entry Rate Rate Rate 



Control Variablea^ 



a/ 



Project Size 

Ninth Grade Academic GPA 
Ninth Grade Academic Course 
Load 

Percent or 11th Graders 
Perccnc of 12th graders 
Percent Male 
Percent .Poor 
Percent Academic Risk 
b/ 

funcciona Performed— 



Identifying Eligible 

Participants 
Identifying Potential Staff 
Assistance with Basic 

Project Proposal 
Securing Additional Funds 
Liaison vith Other Agencies 
Direct Volunteer Services 
Suggestions for Program 

Improvement 



.10 

.u 

.05 
.09 
.09 
.18 
.21 
.04 



.29 



.53 


-.14 


,30 


-.32 


-.19 


.52 


-.26 


.31 


,20 


-.05 


-.06 


.13 


.13 


-.69 


.A3 


.18 


-.10 


.15 


.13 


-.04 


-,34 


-.17 


.19 


-.09 


.27 


.32 


-,25 


-,24 


.19 


-.06 


-.01 


.25 


-,05 


-.18 


-.05 


.34 


.34 


-.40 


,07 


.09 


.14 


.27 


-.21 


.03 


,06 


—07 


-.14 


.29 


.23 


-.22 








.32 



.30 



.30 



-.46 



Proportion of variance ia student 
outcome explained by a regression 
model containing cnly the control 
variables 

Proportion of variance in gtuient 
outcome explained by the final 
stepwise ragressTon nodel 



.210 



.275 



407 



139 



.569 



.465 



.465 



228 



.228 



.063 



.14: 



.275 



438 



MOTE: Tnese analyses vera parfonred using the 45 projects which provided determinate data for ai^ 
variables considered. Given in the table are the partial correlations of each predictor variable" 
wnich vas en-ered in the final stepwise solution, with the student ouccoae measures - 

Ihes^ variables were forcad into the regresdioa equation orior to examining any contribution to 
regression by the activity levels in the functional areas. 

These measures vere computed frsm rasponses to item 22 of the ?DQ and reflect the number of 
specxric activities offered by the project in each of the listed general ar^as . 
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as appropriate, to produce project level units of analysis. Many of the 
res^olting aggregated process measures were reduced to composite indices 
through a priori scale construction or factor analysis. The resulting data 
base produced a set of 54 observations. Several approaches were tak-.n to 
uncover possible relationships among the three basic sets of variables 
(input, process, and output), using the statistical methods of 
multiple discriminant analysis and multiple regression analysis. 

The stepwise discriminant analyses followed two distinct but similar 
paths in attempting to establish relationships among the classes of variables. 
In the first approach, projects were grouped acpording to structural and 
functional classifications (as defined by the sampling frame for the study) 
and these groups were examined for differences in student input and outcome 
measures. In the second approach, projects were empirically clustered in 
terms of student outcome measures, and the resultant groups were examined 
for differences in process and student input measures. The regression 
analyses considered the outcome measures iudividually and examined the 
relationships between each measured output and subsets of process and input 
variables. Stepwise analyses as well as analyses testing rational a priori 
models were performed. 

It should be reemphasized that the analyses described in this chapter 
are exploratory and indicate, at best, relational information. Assumptions 
of causality are in no way warranted. Moreover, the use of stepwise methods 
allows considerable margin for error through strictly data-dependent rela-- 
tionships. Thus, any results of the stepwise procedures should be cross- 
validated to determine if, in fact, a stable relationship exists. Further, 
it should be kept in mind that these analyses in no way attempt to evaluate 
the absolute effectiveness of the UB program, such evaluative analyses 
having been presented in Chapter 7. Rather, the focus of the chapter has 
been an attempt to identify those programmatic characteristics that allow 
one project to better accomplish program objectives than others, while 
controlling for differences in students served. 

The results of the various analyses resist a precise interpretation, 
but one general theme is reflected in the majority of analyses. Project 
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level outcomes as measured in this study show relatively consistent rela- 
tionships to the measured input characteristics of the students in the 
project; however, they show, at best» weak re lationships to project process 
measures when adjustments for the student input measure differences are 
made . 

The relationships between student outcomes and preprocess character- 
i::^tics of the students are fairly intuitive and offer little useful infor- 
^atl^^ri UB program planners. The fact that a greater proportion of 
sr\/deats are placed in 4-year educational institutions by projects with 
proportionately fewer academic risk students is certainly not a surprising 
binding. Any project can determine the preprocess characteristics of its 
tu-irticipants through its selection criteria (for which some latitude 
axi? ts) • 

The one small hint of a relationship betweien process and output comes 
from the frequent occurrence of project size and emphasis of various aca- 
d%*mic year program functions in the variouc- regr^^ Lesion and discriminant 
raodels, and the notable absence, in such models, of measures of emphasis of 
summer program functions. Pro;)ect sizt; may partially reflect activity 
level of the, academic year program, since the measure represents the number 
of students enrolled in the project in the fall of 1973, Post hoc regres- 
sion analyses, conducted to further investigate this possibility, provided 
some small additional support of the major analysis findings. The total 
pattern of findings is suggestive of a positive relationship between level 
of academic year program activity and student outcomes, but there are other 
plausible explanations of this patteim. 

The failure to uncover any systematic or consistent sec of process 
variables which lead to greater success of some projects is disturbing and 
counterintuitive, particularly in light of the latitude allowed in these 
analyses. Clearly, projects differ in terms of degree of success as seen 
in the variability of student outputs over projects. When input differences 
of students served by the projects are controlled, however, none of the 
measures of project process show consistent relationships to the output 
measures. It may be that no relationship between process and outcome 
measures exist, although such an interpretation is illogical. On the other 
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band, the lack of obS)erved relationship could be attributed to many other 
causes: measurement error, inappropriate choice of variables, or inappro-- 
priate analysis models, to name but a few. One reasonable explanation is 
that measurement error and relatively -pervasive relationships between input 
and output jointly mask any existing relationships between process and 
output. If this is the case, then either the relationships are relatively 
weak or the measurement error is large, or both. 

Another possible explanation of this negative finding is suggested by 
site visit observations. Project philosophy and goals differ considerably 
from one project to another, within the limits defined by the legislation. 
Moreover, differing philosophies and goals to lead to emphasis of different 
project intervention strategies, to selection of different foci as to the 
appropriate target student, and to different emphases on the degree to which 
different student outcomes should be maximized* Both the program implemen- 
tation and the type of student to be served will be influenced by this 
basic philosophy, and, to the extent that the project is successful in 
attaining its goals, it should be measured as *'more successful" in terms of 
the output measures on which it has concentrated and ''less successful'' for 
those output measures toward which it has devoted little attention. 

If this is the case, and visits to 15 of the UB projects do suggest it 
as a strong possibility, then there are two implications for this study or 
future ones. First, this possibility implies that input measures and 
process measures are confounde d. That is, different processes are used 
because ox the fact that different types of students are selected, and 
different students are selected because a program has geared its process to 
that particular type of student. With this type of confounding, statistical 
adjustments for input differences, such as those used* in this chapter, 
would tend to wash out any effects due to process. 

The second implication is that lacking unitary purposes among projects 
(even though the purposes of the program are generally stated in the legislation 
and guidelines governing program operation) , the effectiveness of a given 
project, relative to other projects, should be judged on the basis of 
outcomes toward which that project is striving. Given the particular aim 
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of a project, some outcomes will be sraphasized more than others (and 
probably at the expense of others). If one accepts this h3rpothesis, then 
the results of the empirical clustering of projects on these three outcome 
measures is quite reasonable. Only one group of projects was consistently 
below average on all three outcome measures, and only one cluster exhibited 
a strictly above-average profile. Ths remaining clusters showed, in general, 
very high relative effectiveness on 3ome outcome measures but very low 
relative effectiveness on others. 

This explanation is quit<i consistent with the pattern of findings 
reported in this chapter. To investigate these hypotheses more fully, 
however, would require different approaches to both design and measurement 
than those employed in this study. 
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Chapter 9 



Smnmary and Conclusions 
I. PURPOSE, DESIGN, AND METHODOLOGY 

A. Purpose mJ! 

Under authority of the Economic Opportunity Act of 1964, as amended 
(42 U^S^C. 2809), the Office of Kconomic Opportunity (OEO) funded 17 Upward 
Bound (UB) projects as a pilot program in the summer of 1965% In 1966, UB 
was authorized as a national program under Title II-A of the Economic 
Oppprtunity Act. On July 1, 1969, responsibility for the program was 
transferred from OEO to the U,S. Office of Education (USOE) , Department of 
Health, Education, and Welfare (HEW). Currently, UB is authorized under 
section 408 of the Higher Education Act of 1965, as amended (20 U.S.C. 
1068) • The purpose of UB is to prepare and motivate high school (HS) 
students to succeed in secondary and postsecondary education. The program 
is targeted for low-income youths who have potential for education in and 
beyond HS but who lack motivation and/or adequate HS preparation, and are 
thus unlikely to achieve a postsecondary education (PSE) without assistance. 

In July 1973, USOE awarded the Research Triangle Institute (RTI) a 
contract (number OEC'O-73-7052) to plan and conduct an evaluation of the UB 
and Talent Search (TS) programs. RTI carried out the planning study during 
the period of June 1973-January 1974; the actual studies were implemented 
and conducted from February 1974 to March 1976. (The results of the TS 
study are reported in Volume III of this report.) 

The legislatively mandated objective of the UB program is the generation 
of the skills and motivation necessary for success in education beyond HS. 
The primary goal of the RTI study of the program was to evaluate the 
accomplishment of two of the program's objectives related to the legislative 
mandate: (1) to increase the HS retention rate of its participants, and 
(2) to increase the rate of entry of its participants into institutions of 
PSE. Evaluation of attainment of actual skills and motivation was a second- 
ary goal of the study, primarily because of practical problems involvfc.d in 
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determining and measuring the nature and degree of such skills and motivation. 
The current study was, however, designed to provide the basis for a limited 
longitudinal study whereby this third objective could more fully inves- 
tigated. Another secondary study goal was to provide a detailed description 
of the UB program as it existed during the 1973-74 program year, including 
characteristics of the staff and students, their perceptions of the program, 
and project operations and costs. 

Given these study goals, the study focused on the 333 regular UB 
projects operating in the cotenainous United States during the 1973-74 
program year. The 83 projects operating outside the coterminous United 
States and/or classified as special Veterans or demonstration projects were 
excluded. The conclusions presented in this chapter are based on the body 
of eyidence obtained from the study of these projects. 

B< General Design 

Several sources were consulted in designing the study, including the 
enabling legislation, the official guidelines, and the relevant research 
literature (in particular, the Greenleigh Associates report of 1970 and the 
GAO report of March 1974) . Heavy use in the des?;gn phase was also made of 
selected program personnel, current and former UB staff personnel and 
students, and three study advisory councils or panels. Taking into 
consideration input from these sources and certain study constraints, the 
UB evaluation utilized a quasi-experimental design in which a sample of UB 
students and a sample of comparison students were studied through a short 
period of time. 

The resulting design was basically cross--sectional, with the collection 
of some retrospective and short-range longitudinal data. A synthetic 
cohort approach was incorporated, making it pcssible to estimate the transi- 
tion of UB and comparison students from tenth grade entry into postsecondary 
education. Although the adopted design was limited, it was capable of 
evaluating study objectives within the time limit requested by USOE; it 
required relatively small samples and was thus less costly; and it had 
potential for expansion into a longitudinal study • 
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C. Sampling Proceduras 

To satisfy the study objectives and to obtain results that would 
contain a minimum of bias, data were collected from many sources and from a 
broad spectrins of persons. Multistage probability sampling techniques, 
which allow unbiased estimates from the sample data, were employed to 
select the necessary' samples of projects, project staff, HSs, and students. 

In the first sampling stage, 54 of the 333 eligible UB projects were 
selected after stratification on such characteristics as ethnicity of the 
majority of students, number of students served, project location, project 
emphasis, and type of host institution. Afe a second step, all UB participants 
in each sampled project who were in grades 10, 11, or 12 in September or 
October 1S73 were selected into the UB student sainple. The final sample 
contained 3,710 UB students. 

Comparison students were defined as students in the same grade levels 
and HSs as the UB students, and who were similar to UB students in ethnicity, 
low iticome status, and academic risk status. For each(_UB project selected 
into tVie sample, one or more HSs providing students to that project were 
selected (averaging two per project). Using data obtained from teachers of 
sampled classrooms in each of these HSs, a total of 2^340 comparison students 
(about 21 per sampled HS) were Sv^lected on the basis of grade level, ethnicity, 
low income status, and academic risk status. 

In each sampled UB project, the project director and a sample of 
counselors and instructors v/ere selected for the questionnaire survey. In 
general, six staff members per project were chosen, with proportional 
representation of counselors and instructor.^ . The final sample of UB 
project staff included 54 project directors, 104 counselors, and 211 
instructors. 

Finally, 15 of the 54 sampled UB projects were subsampled for site 
visitation. This sample of 15 projects was selected to include at least 
one project from each of 10 USOE regions, and to be representative of the 
population of UB projects with respect to the ethnic composition and residence 
of participants. Three of the 15 projects were also selected because they 
had strong academic programs which functioned during the school year as 
well as during the summer. Five of the 15 projects, including the three 
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projects with strong academic and sucnner programs, were designated to 
receive two site visits — one during the academic year and one during the 
summer. 

D. Instrumentation and Data Collection 

A total of 11 instruments (several of which were available in slightly 
different forms) were used in collecting data through questionnaire responses, 
interview responses, and student records. Three of these instruments were 
questionnaires used to obtain information directly fror- students; four were 
forms which provided information about students and were completed by HS 
teachers, RTl study administrators, or UB project staff members; three were 
UB project staff questionnaires that were mailed to UB project directors, 
project counselors, and project instructors; and the remaining form was a 
site-visit protocol. 

One of the instruments completed by students, the Basic Student 
questionnaire (BSQ) , was administered in the spring of 1974 by RTI study 
administrators to the sample of UB and comparison students who were available 
at the HSs or projects. A special student Dropout/Transfer Questionnaire 
(D/TQ) was mailed to those UB and comparison students who were not available 
for the spring administrations of the BSQ (e.g., UB students who left the 
program and/or HS, comparison students who left HS, or UB students who were 
otherwise absent from the test administrations) . The third student question- 
naire, the Fall Status Questionnaire (FSQ) administered in the fall of 
1974, was used both as a mail survey instrument and as a telephone survey 
instrument. 

One of the four forms used to collect information about students was 
the HS Classroom Roster (HSCR) that was mailed to and completed by homeroom 
teachers for the comparison students in the sample. The second was the 
Student Transcript Form (STF) , used by RTI study administrators to gather 
academic record information on UB and comparison students. The third was 
the Survey Administrator Roster Form (SARF) , used by RTI study administrators 
to record reasons for absence of students from the administrations of the 
BSQ. The fourth was the Project Roster Verification Form (PRVF) , mailed to 
directors of each of the sample UB projects, who completed it by verifying 
a list of UB students reported to have been in that project in the fall of 
1973 and by specifying the grade level for each verified participant. 
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Return rates for these qmestionnaires were in most instances accept- 
able. Very low return rates were experienced, however, with the D/TQ. 
These questionnaires were mailed (without extensive folloxmp) to those 
students who had left the HS or project, or who had previously failed to 
respond to the BSQ, and who were, as a result, difficult to locate and 
probably less motivated to respond. Approximately 85 percent of the UB and 
CS groups completed the BSQ administered in spring 1974, and approximately 
80 percent of both groups responded to the FSQ Neither by mail or telephone) . 
Some questionnaire data were cailected for 99. S percent of the UB group and 
98.3 percent of the CS group. 

The three staff questionnaires were mailed in the spring of 1974 to 
the sample of project directors, counselors, and instructors. The ret;im 
rates for these staff questionnaires were generally acceptable; 89.9 percent 
for project directors, 80.8 percent for counselors, and 72.9 percent for 
instructors. Complete staff data (i.e., questionnaires returned by all 
sampled staff in a project) were available for only about one^th-^rd of the 
projects sampled. For about 70 percent of the projects, questionnaires 
were available for the project director and for at least half of the coun-- 
selors and instructors who were sampled. 

The site-visit protocol provided the overall guidelines for each site 
visit, including the list of najor topics and related questions to be 
pursued in the 183 interviews conducted with project directors, project 
staff, students, and other persons associr-ted with projects and host insti- 
tutions. Based on the impressions gained through t:hese unstructured inter- 
views and observations of project activities, a report was prepared for 
each of the 15 visited sites. 

E. Data Qualit y 

The generally satisfactory response rates do not, by themselves, give 
an accurate picture of the extent of missing data for specific questionnaire 
items, or of the quality of the available data. Consequently, extensive 
checks for missing data, out-of-range data, multiple responses, and incon- 
sistent responses (including skip pattern inconsistencies, inconsistencies 
within instruments, and inconsistencies betwean instruments) were performed. 
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When feasible, logical and stochastic imputation techniques were used to 
rectify some problems of data quality. 

Multiple and out-of-range responses within each questionnaire were 
infrequent. Item nonresponse within questionnaires occurred at a consider- 
ably greater rate; however, such nonresponse was concentrated within a few 
items and individuals. There was no serious problem of differential data 
availability between the UB and comparison students or among projects. In 
all, the extent of unavailable data had no serious impact on the analysis. 

Inconsistent responses raised some serious questions regarding data 
quality. The major inconsistency problems within instruments arose from 
questionnaire items that were nested within complex skip patterns. Conse- 
quently, these items were used sparingly in the. analysis. In only few 
isolated cases was the incidence of logically inconsistent responses within 
specific questionnaires sufficiently large to pose serious analysis problems, 
and in such cases the data item was not analyzed. A matter of greater 
concern was the number of inconsistencies observed between the responses 
';:ro:a two different sources of data (posing questions as to source credibility) . 
Such inconsistencies were unexpected in light of the relatively objective 
nature (e.g., grade in HS, entry into PSE) of the responses being compared. 
For some data elements > inconsistency rates approached a high of 25 percent.- 
The overall picture of intersource inconsistency was somewhat brighter for 
the major set of student variables considered (a maximum inconsistency rate 
of 4 percent for the 22 major variables). 

A final problem related to data quality was the nonrepresentativeness 
of the. data from the various respondent subgroups. While the direct analysis 
implications of the subgroup differences cannot be directly stated, there 
is strong indication of possible bias in results obtained for specific 
questionnaire respondent groups. Fortunately, differences between subgroups 
of respondents within the UB group were quite similar to those in the CS 
group. This suggests, but does not guarantee, that comparisons between the 
groups should be relatively free of bias, even when these comparisons are 
being made within a particular responding subgroup (such as respondents to 
the BSQ). 
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F. Analysis 

In addition to routine analysis of data quality, three major classes 
of analyses were conducted: (1) student-oriented analyses, (2) program- 
oriented analyses, and (3) project-by-student analyses. Every effort was 
made in these analyses to avoid misinterpretations from spurious results. 
Sampling weights were used where feasible in computing the various statis- 
tics to provide, unbiased estimates of population parameters. Weight adjust- 
ments were made for both item and instrument nonresponse. 

The first class of analyses addresses questions of the effectiveness 
of the UB program with a primary focus on differences between UB partici- 
pants and nonparticipants. Although the sample design effectively minimized 
differences between the UB and CS groups on certain input-related factors, 
a statistical procedure was used to effect an a posteriori equalization of 
the two groups. 

The thrust of the program-oriented analyses is descriptive and either 
the project, specific project personnel, or subgroups of UB participants 
served as the units of analysis. The project-by-student analyses investi- 
gated relationships betwe^en a set of variables reflecting output measures 
and sets of student input and project process measures. For these analyses, 
concern shifts from national program effectiveness to an evaluation of 
differential program operations and the relative value of particular approaches 
to UB objectives. 

II. SUMMARY AInD INTEFJ>RETATI0N OF MAJOR FINDINGS: 
CHARACTERISTICS OF UB PROJECTS, STAFF, AND STUDENTS 

A major finding of the study, supported by the impressions gained by 
the site visitations and the analyses of the various questionnaire responses, 
is that UB does not appear to represent a single intervention treatment, or 
even two or three clearly delineated treatments. It is not easy to describe 
a typical project except in the most general terms. Variation, rather than 
commonality, was the salient aspect of program description for most of the 
dimensions considered. Within the general limits established by program 
guidelines, projects varied extensively in terms of the students served and 
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the way in which specific intervention strategies were implemented. Pursuit 
of the general objectives of the UB program appeared to be common across 
projects, but particular programmatic emphases and assumptions relative to 
the attainment of the general objectives showed considerable variation 
among projects. 

A. Project Costs 

The analysis of the sources and uses of funds provided a descriptive 
profile of the financial characteristics of the UB projects. The wei^^hted 
estimate of average total cost per project (excluding in-kind contribUw:?ons) 
was $111,986 for the 1973-74 program year. For the -1973 summer program, 
the estimated cost was $63,769 per project or approximately $830 per student 
served; for the 1973-74 academic year program, the estimated average cost 
was $51,863 or approximately $700 per student served. Over 90 percent of 
these monies were contributed by federal sources. Projects reported receiving 
an average of $9,149 worth of in-kind contributions, such as office space, 
facilities, and personnel services, although these estimates may be low. 

For the summer program, personnel costs accounted for about 45 percent 
of the sum of all reported component costs, other direct costs accounted 
for 50 percent, and indirect costs accounted for the remaining 5 percent. 
Analogous costs for the academic year program were 50 percent, 45 percent, 
and 5 percent, respectively. Thus, wages and salaries constituted the 
largest single expense, followed by payment for student room and board (26 
percent of summer program costs and 12 percent of academic year program 
costs), and for student stipends (6 percent of summer program costs and 14 
percent of academic year program costs) , ' 

Considerable variability was observed in the reported project cost 
figures . The range of reported total costs, excluding in-kind contribu- 
tions, was from $9,792 to $175,000 during the summer program and from 
$19,500 to $134,000 during the academic year. Nonfederal support ranged 
from $0 to well over $100,000, with the preponderance of projects reporting 
no nonfederal funding. 

Examinations of associations between project costs and certain project 
characteristics uncovered only a trivial relationship; the number of students 
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served was found to be positively associated with total project costs. 
This relationship was observed for the total program year, and within 
summer and academes year components. Vlhen numbers of students served is 
controlled,, no significant differences in project costs were found between 
projects housed at public vs. private institutions, or projects in rural, 
small urban, or large city locations. These results are not surprising 
since project funding is determined by a formula which accounts for number 
of students to be served. 

In summary; the average federal cost per student for the summer 
program was about $830 in 1973-74, and for the academic year program 
about $700. The project dire c tors estimated that less than 10 percent 
of program costs come from nouirederal sources, either cash or in-kind 
contributions; the programs thus depend heavily on federal funding. 
About half of the project funds are used to support staffing costs, 
and from one-fourth to one-third of the funds are used for student room^ 
board, and stipends. Variability of total costs among programs was found 
to exist, of course, but appeared to be principally a function of the 
number of students served, and not of such factors as host institution 
characteristics or urban-rural origin of students . Thus, federal costs 
appear not to have escalated sharply since 1969, if the Greenleigh survey 
figure of annual per student cost in that year of $1,331 can be accepted as 
comparably derived; and, no factors were observed that would suggest 
institutional or urban-rural inequities in funding. 

B. Project Staffing 

On the average, the sampled projects were staffed by one and one-half 
full-time equivalent (FTE) administrative employees during both the academic 
year and summer programs. The average number of FTE support personnel was 
slightly greater in the summer (3.7) than in the academic year (2.4). The 
major staffing difference between the two program components was found in 
the area of service delivery (e.g., instructors and counselors). Projects 
were staffed, on the average, by 4.3 FTE service delivery employees during 
the academic year but this number increased to 11.5 during the summer 
program. There was considerable variation about these average staffing 
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profiles, but no significant associations were found to exist between 
project staffing patterns and other project characteristics. 

Most staff members were young (age 35 or less), although project 
directors as a group were slightly older than the instructors and coun- 
selors. Nearly all project directors, and over half of the instructors and 
counselors, were male. The greatest proportion of project directors were 
black (47 percent) , while the greatest proportion of instructors and coun- 
selors were white (55 and 42 percent, respectively). Also represented 
among UB staff were American Indians, Mexican. Americans , Puerto Ricans, and 
Orientals. These four categories in combination accounted for 19, 11, and 
24 percent of the directors, instructors, and counselors, respectively. 
Based on site visitation data, projects appeared to employ staff of the 
same ethnicity as that of the student participants, though not alw2iys in 
the same representative proportions. Staff members tended to come most 
frequently from families where the fathers were laborers or service workers 
(50 percent of the directors and nearly 40 percent of the counselors and 
instructors) , although the f athery of from 15 to 20 percent were reported 
as professionals. 

Most staff personnel had obtained at least a bachelor *s degree, with 
slightly more than half having obtained a degree at the master *s level or 
higher. Over a third of the staff reported participation in continuing 
education at the time they completed their questionnaires. In addition, 
the majority of project directors and counselors, and approximately 40 
percent of the project instructors, had attended some type of ::raining 
institute which offered special training in teaching, counseling, or program 
administration for "disadvantaged** students. For the most part, the course 
work and training completed by the UB project staff appeared directly 
related to their job needs. 

In addition to their formal training and education, UB project staff 
generally had a good deal of practical experience in their field of work, 
and to a lesser extent, working specifically with disadvantaged students 
(although for the most part this experience had been gained in v/orking with 
the TRIO Programs). Most project directors reported several years of 
experience working with disadvantaged students in either an administra?:ive 
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or some other capacity, or both. Over 80 percent of the instructors reported 
at least 1 year of full-time teaching experience ^ while 60 percent reported 
having 5 or more years of teaching experience. Counselors as a group 
reported somewhat less experience in their field than did the instructors. 

There appeared to be a fairly high turnover of instructional staff, 
reflecting a policy of replacing one- third of the instructors each year. 
The turnover suggested by the program guidelines is intended to expose 
larger numbers of HS teachers to the UB program. Turnover may also serve a 
screening function; or, it could reflect the uncertainties in year-to-year 
funding with confirmation of funding coming generally just before new 
programs must begin. In any case, given the short period of time that many, 
projects have been in operation, and the apparent fact that on-the-job 
experience is the most frequent source of highly relevant training, it 
would appear that special training programs could be most valuable, and 
could also facilitate the development of a professionalism and commitment 
to the special compensatory and motivating challenges these staff face. 

In summary; projects appear to he adequately staffed, with individuals 
of acceptable levels o£ formal training and experience for their positions. 
Stafi turnover, and the fact that the majority of specifically relevant 
experie nce is gained from participating in the program, may suggest that 
special additional training would be desirable. 

C. Staff Duties and Work Loads 

Staff members spent the largest percent of their working time as would 
be expected; that is, the greatest proportion of the director's, instruc- 
tor's, and counselor's time was spent on general administration, teaching, 
and counseling, respectively. However, all staff members performed a 
number of activities in common, principally, teaching and counseling. Some 
few staff members reported that their time was distributed among specified 
activities in a manner which was very discrepant from an ideal allocation 
of time. There was, however, no consistent trend in any of the three staff 
g^Q^Ps to report that more or less than an ideal amount of time was being 
allocated to any specific activity. 

During the summer program, full-time instructors taught an average of 
2,9 clasises, while part-time instructors averaged a slightly lower workload 
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cf 2-4 classes, but the distribution of teaching load reflected consider- 
able diversity. Almost 13 percent of full-time sununer instructors were 
teaching one class or less during the sutomer, while over 18 percent of the 
part-time instructors were teaching four or more classes during the same 
period. 

In performing their teaching functions, instructors reported extensive 
use of individualized instruction. Other common practices reported a? used 
extensively by at least a third of the instructors included seminars or 
class discussions, open classrooms, and nongraded classes. In contrast, 
there was little reported use of competitive and noncompetitive grading 
systems, team teaching, or ability grouping. 

During the summer program, the median number of students counseled per 
week in individual or group sesrdons was the same (about 16.5) for both 
full- and part-time counselors. During the ircademic year, the median 
numbers of weekly individual counseling sessions (and the median number of 
students counseled) for full- and part-time counselors, respectively, were 
10,1 and 6.3, Full- and part-time counselors served a weekly average of 
22,9 and 3,8 students, respectively, in group sessions during the academic 
year. The median lengths of individual counseling sessions both during the 
summer and academic year was about 30 minutes for full-time counselors, and 
about 22 minutes for part-time counselors. Medlar* . group session lengths 
were about 40 minutes in both summer and academic year programs for full- 
time counselors and about 26 minutes for part-time counselors. Most full- 
and part-time counselors reported that each student attended a total of two 
to four counseling sessions during the summer and academic year programs* 
Major concerns expressed by students during these counseling sessions x^ere 
with entry into 4-year colleges, personal and family problems, social and 
situational problems, high school acadeiaic problems, and finances. 

In summary: most staff member^ appear to be carrying reasonable 
work loads, and to be directing their energies efficiently toward their 
UB project duties. Administrators^ i nst ructors^ and counselors perform 
many functions or activities in coronic ^: . Instr u ction tends to be orien t ed 
toward group discussion or individualized instruction, and competition 
is deeuiphasized. The work load seems to be equrlly spread over full-time 
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and part-time staff members. Full-time instructors teach only slightly 
more classes than part-time instructors, on the average. Part-time 
and full-time counselors carry the same number of students in the sumer 
but part-time counselors serve fewer students in the academic year than 
do full-time counselors, particularly in group as opposed to individual 
sessions. Part-time counselors spend slightly les s time with their 
counselees than do full-time counselors. 



D. Recruitment and Characteristics of S tudents 

UB students reported first hearing about the program from a variety of 
sources, the most frequent of which was other UB students (30 percent). 
Othe^r sources mentioned by over 5 percent of the students were school 
guidance counselors, UB staff members, and school teachers. These results 
support the site visit observations that formal student recruitment was 
carried out in most projects by "contact counselors" or other personnel 
employed not by UB but by the feeder high schools. U3 project directors 
and staff assumed responsibility for the final selection of students (using 
various criteria but generally considering factors such as student poverty 
status, student grades and aptitude test scores, teacher and counselor 
recommendations, evidences of student motivation, and personal intuition). 

' Many ethnic groups were represented by U3 students in the 1973-74 
program year: approximately 61 percent were black; approximately 18 percent 
were white; and approximately 20 percent were American Indians, Mexican 
Americans, Puerto Ricans, and Orientals. More UB students were females (56 
percent) than males. Approximately 35 percent of che students were 16 to 
18 years of age; and approximately Ij, 39, and 45 percent were in grades 
10, 11, and 12, respectively ♦ It should be noted here that although projects 
have staff of the same ethnicity as the students, project staff proportion.^, 
by ethnicity or sex, do not match student proportions. For example, 47 
percent of the project directors, and about 33 percent of instructors and 
counselors, were black; 34 percent of project directors, 55 percent of 
instructors, and 42 percent of counselors were white. /Although Native 
American and Mexican American project directors appeared in about the sane 
proportions (19 percent) as .students of similar ethnicity, only about 10 
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percent of the instructors were in these categories; counselors in these 
ethnic categories represented about 24 percent of the population of coun- 
selors, but of that only about 3 percent were Native American. Only one 
Oriental (an instructor) appeared in the sample of 286 staff members 
responding. Almost 90 percent of project directors, and about 55 percent 
of the counselors and instructors, were male. 

Based on ninth grade academic information, slightly more than half of 
the UB students were classified as being "academic risks." Also, slightly 
less than half had been enrolled in a general course of study in the ninth 
grade, about one-third had been enrolled in an academic curriculum, and 
only 10 percent had been enrolled in a vocational/business course of study. 
With regard, however, to the definition and interpretation of "academic 
risk" or the promise of academic attainment following program participation, 
much fuzziness and potential variability exists. Project staff tended to 
rely on school recommendations and personal intuitions, variously formed, 
in selecting the relatively small numbers of students among applicants or 
potential applicants that could be accommodated. Low motivation and 
relatively low grades were frequently cited as a basis for selection, yet 
some, project staff reported seeking students vith clear evidence of high 
motivation and tolerated high academic performance if the low income criterion 
was met. The lack of operational specificity in the definition of the 
target group not only interjects difficulties in accounting for input and 
process interactions, but also reinforces the supposition that different 
programs do (or should do) different things if their students are to be 
properly facilitated. 

Using an index that is closely related to, but not identical to, 
federal poverty level guidelines, approximately two- thirds of the UB students 
were considered to be at or below poverty level. Roughly one-half the 
parents of UB students had attained a formal education equivalent to or 
greater than a high school degree. Less than 5 percent of the parents had 
as much as a 4-year college education. The majority of fathers were laborers 
or service workers; the majority of mothers were either homemakers, laborers, 
or servic'.^ workers. Approximately 5 percent of the UB students had also 
participate:d in a Talent Search (TS) Program. Slightly over half of the UB 
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students reported no participation in other intervention programs (exclu- 
sive of TS and UB) . 

Directors, instructors, and counselors showed a high degree of simi- 
larity in their ratings of the UB students in their project. All three 
perceived UB students to be most proficient in peer relations and creativity. 
Student general academic ability was rated to be above average by all staff 
categories. The lowest ratings were given to student attitudes toward 
authority and toward school; but student attitude toward life was rated 
quite high. The students' self-concept and attention span were also rated 
poor. 

In siinmary: althouj^h the prosraia appears to contain a majority of 
the kinds of students for which it is intended with regard to poverty 
criteria (and perhaps with regard to ethnicity), the definition of the 
target group with regard to academic achievement potential (or to nature 
of detriment to academic achievement, other than poverty status) ap^pears 
to vary as a matter of its inherent lack of specificity, operational 
feasibility., or differences in interpretation among staff in various 
pro;iects. Some of th e differences found (e*g., projects d eliberately 
recruiting, highly motivated, but perhaps otherwise disadvantaged students) 
may represent a desirable heterogeneity, but this heterogeneity appears 
to result from variability in personal convictions or preferences of 
project staff or lack of a manageable degr ee of p reciseness in the 
definitions of target j^roup in the legislation or in the guidelines.- 
This is not to state, however, that ineligible or undeserving students are 
being served, but that a variety of kinds of disadvantagement are probably 
now (haphaeardly) represented* 

E. Project Activit ies and Services 

A wide range of courses <ind classes, tutoring and counseling services, 
sports, social and cultural activities, and medical and dental services 
were offered by projects during both tne summer and academic year programs. 
Tutoring and counseling services were generally offered by all projacts 
during both sessions, but there was greater variability "in availability of 
other activities. The greatest variation occurred in the availability of 
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sports and specific types of courses. A greater variety of courses seemed 
to be available during the summer program than during the academic year. 
During the academic year, a greater number of projects offered counseling 
and other assistance concerned with the more immediate needs of obtaining 
jobs than were offered during the summer program. The two functions rated 
(whr^ther by directors, instructors, or counselors) as being the most empha- 
sized during both summer and academic year sessions were tutoring/remedial 
instruction and counseling. Cultural enrichment activities during the 
summer and community and school liaison work during the academic year were 
the third most emphasized functions. 

Project staff questionnaire responses are consistent with site-visit 
observations of the programmatic differences between the academic year and 
summer sessions. During the academic year, some students experienced a 
program consisting of irregular raaetiugs concerned mostly with counseling; 
others experienced a series of weekly meetings involving counseling, 
tutoring, and formalized classes. Some projects devote considerable time 
to applying for college admission and financial aid, others place much less 
emphasis on this matter. In short, the academic year program activities 
appear to vary markedly from project to project. 

Project summer programs, on the other hand, are much more likely to 
pZ'ovide a common set of experiences; i.e., 6 weeks of formal classes, 
recreation, extensive counseling and tutoring, cultural activities, and 
exposure to the wider world of the host institution. At the same time, 
there were important differences in the degree of structure in the summer 
program. Some programs were highly structured and offered students little 
freedom in choosing course options; others were quite laiss e z A^^j^g, 
their approach to students' selection of courses, class attendance, and 
f ollowthrough on academic and other responsibilities. 

Given a list of 32 specified UB activities and services, UB students 
indicated those activities which were available and those in which they 
participated. Additionally, they rated the degree to which they were 
helped by each of the activities in v;hich they participated. With few 
exceptions all the listed courses and services were available to at least 
two-'thirds of the students. Courses generally available to all but a few 
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students (15 percent or less) included: basic subjects such as reading, 
remedial English, English, remedial mathematics, and mathematics. Counseling 
services and other activities related to entry inco postsecondary education, 
and such cultural enrichment activities as sports, social gatherings, and 
cultural events were also reported to be generally available. 

The activities most commonly available to most UB students were also 
characterized by the highest participation rates (among those students for 
whom the activities had been available) and were considered to be the most 
helpful (among the students who had participated). The common availability, 
participation, and reported helpfulness of these activities support the 
reports of staff members that tutoring or remedial instruction, counseling, 
and cultural enrichment are three of the mv.jt emphasized and valued functions 
in the UB program. At the same time, a minority of students, sometimes 
reaching substantial proportions and seldom dropping below 10 percent, 
rated the activities as "of little or no help to me." The activities more 
frequently perceived as of little help inclujed: help in finding Jobs (33 
percent so rating this activity); art or music courses (25 percent); 
tutoring by other students in the program (27 percent); individual coun- 
seling on personal problems (19 percent); counseling on choice of career 
(17 percent); or courses in learning how to study (17 percent). These 
reactiorLS may ba based, of course, on differential student need or interest 
or on differential effectiveness of the function in meeting the needs it 
was designed to serve. 

In summary: although the overall jprogram exhibits considerable 
variability — particularly in the academic year component — UB seems to be 
effective in providing and delivering the basic activities required by 
the guidelines. At the same time, not all students find all project 
activities helpful (as might be expected)^ with one-quarter or more finding 
vocational placement, counseling on personal problems, fine art courses, 
or tutoring by other UB students to be of little or no I <> i.p. 

^* Staff Rating of Teaching Behaviors and Educational Goals 

There was an extremely high degree of agreement and similarity in the 
ratings of educa!:icnal goals by project directors, counselors, and instructors. 
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In general, the staff agreed that the more important goals of education 
were developing student enthusiasm for learning, helping students to feel 
important, and providing students with a solid grasp of fundamental skills. 
Lowest ratings were given to the goals of developing language skills in 
English for the students from non-English speaking backgrounds, and increas- 
ing student effectiveness in dealing with authority figures. 

Instructors rated the following behaviors to be most important in 
their teaching: encouraging students to become involved; giving students 
praise and affection; answering student questions; encouraging students to 
make choices; talking with students; and diagnosing individual learning 
problems. Considered to be of less importance were the use of disciplinax'y 
measures, working with parents, establishing a clear time structure, and 
using rewards to shape behavior. These ratings of the importance of teaching 
behaviors were generally congruent with the instructors' ratings of educa- 
tional goals. 

G. Student Evaluations of UB Projects 

UB students rated the quality of 15 instructional and/or operational 
aspects of their projects (curriculum content, quality of administration, 
and staff and student interrelationships) separately for the academic year 
and summer programs. Although the rating patterns were similar, the average 
ratings of academic year program were slightly lower than that of comparable 
elements in the summer program. In general.^ project aspects were rated as 
quite good for both sessions; however, some project elements were rated no 
better than "fair'' by substantial proportions (from 10 to 45 percent) of 
students. Most frequently in this latter category were amoxmt of student 
stipend V participation by parents, or student-directed discipline activity. 

Students perceived the UB program's central functions such as day- to- 
day operations of teaching, counseling, and administration (including 
discipline) to be well conducted and organized. They considered the best 
qualities of the program to be the staff's interest in the students and the 
harmonious relationships that existed among the staff and among the students. 
They also prized highly the staff's willingness to accept student suggestions. 
Interviews with students during the site visits generally confirmed the 
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student questionnaire responses. The students interviewed were generally 
enthusiastic': about project activities, appreciative of the opportunity to 
"learn and still have a good time," and generally expressed particular 
loyalty to the UB project and its staff. They also expressed a more favor- 
able reaction to the sunmier component than to the academic year component. 

Of the potential benefits attainable from UB participation, students 
rated gaining a better understanding of the need for education and being 
prepared to gain admission to college or other types of schools as being 
most important. Personal development and interpersonal growth were seen as 
next most important. The potential benefits regarded as being less important 
were: having a chanji^e from the routine of regular school, making close 
friends, participatXK.^]; in extracurricular activities, and obtaining financial 
aid for medical services and other needs beyond the UB stipend* Importance 
of the potential benefits is, however, a relative concept, and even for the 
least important benefit fjubstantial proportions of students felt it very 
important. 

_ In general, the degree to which each potential benefit was perceived 
as important was directly related to the extent to which the benefit had 
been received. There were, however, some deviations from this trend — the 
most marked of which was the coni>iderable proportion of students who viewed 
as important the benefits of learning better study skills and becoming 
better prepared for postsecondary education but who reported receiving the 
benefits to only a moderate degree. 

With one exception, a plurality of students indicated that no changes 
had been perceived in the way '^signif icant others" had changed their opinions 
about.them as a result of their participation in UB, The exception involved 
parents, and approximately 55 percent of the students felt that their 
parents thought more highly of f:hem because of their participation in UB. 
Of those students reporting changes in the opinions of others, substantially 
higher proportions indicated positive rather than negative change (students 
indicating negative change wer2 in nhe 1 to 3 percent range, while those 
indicating positive change were in the 27 to 39 peicent ra-ge). 

In summary: students involved in the UB projects appear positive 
abo ut the staff and their program experience. The quality of the curriculum. 
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of counseling and tutoring, and of overall administration is perceived as 
quite high, as is the pattern of staff and student interrelationships. The 
self-reports of the students strongly suggest that they are incorporating 
program objectives into their own behavior, self-concept; and aspirations^ 

H. Relations with Host Institutions and Other Supporting Groups 

In general, UB staff reported receiving moderately effective support 
from their host institutions, their advisory coirmittees, and other parent 
and community groups. The staff and students reported good relationships 
internally among staff and students, suggesting that in most projects the 
directors, staff, and students formed a hiphly cohesive group. Practically 
all project directors reported the existence of a Parent Advisory Committee; 
while approximately half reported the existence of a Community Resources 
Committee. Nearly all projects wit:h the specified committees reported 
meeting at least twice a year, with a majority holding meetings at least 
four times a year. 

Amost 90 percent of the project directors rated their host insti- 
tutions (primarily public and private colleges and universities) as being 
supportive, but no host stitution was seen as unsupportive . Ev?'.dence of 
host institution support and commitment to specified projects, and to the 
UB concept in general, was also obtained in site visits. Host institutions 
at most visited sites gave faculty or administrative status to project 
directors; many included theii regular instructors in the summer program; 
and, virtually all made the programs and facilities of the institution 
available to UB students on an equal basis with the regular stud^^int body. 

The majority of UB host institutions also administered other programs 
for the disadvantaged. About half administered Special Services projects; 
and approximately 15 percent administered Talent Search projects. Most 
project directors also reported that other programs for the disadvantaged, 
that were not administered by their host institutions, operated in the same 
area. Other UB projects operated in the area of about half the reporting 
projects. Other programs reported as operating in their area by over half 
of UB directors were T-r ^^.nt Search, Special Services, Neighborhood Youth 
Corps, High School V..r]-: ;.tudy. Veterans Programs, and High School Equivalency 
Programs. 
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Most project directors reported cooperative relationships with these 
other programs in their areas. UB instructors and counselors also reported 
receiving a high degree of cooperation from high schools and postsecondary 
institutions. This high degree of cooperation is extremely important 
because UB proje^'cts typically depend on: (1) high schools for recruiting 
students, writing information about the student's school performance, and 
developing complementary programs of study for students; and (2) post- 
secondary institutions for processing UB participant applications, granting 
admission, administering financial aid, and providing for the needs of 
students in the institutions. 

Many project directors interviewed during site visits felt the need 
for more assistance, monitoring, feedback, and direction than they were 
currently receiving from the national and regional offices of USOE. A 
special concern common across projects and regions was the timing of 
notification of funding and consequent late funding. 

In summary: the projects appear to be very much at home with, and 
an integral and accepted part of, their host institutions; they appear 
effective in utilizing other facilitating instrumentations provided by 
the institutions and communities. They would generally like more contact 
with, and direction and assistance from, the national and regional offices 
of USOE, 

III. SUMMARY AND INTERPRETATION OF MAJOR FINDINGS: 
ATTAINMENT OF BASIC UB OBJECTIVES 

To evaluate the attainment of basic UB objectives, a series of analyses 
were focused on comparative student outcomes for the populations of UB 
participants and comparison students, or for certain subgroups thereof. 
Differences between these populations on sucii factors as grade level, sex, 
race, academic risk, poverty status, and general region, state, district, 
or school-specific educational environments were reduced by the sample 
design or by a posteriori statistical equalization of the two groups. 
After balancing, the UB and comparison student populations were, in general, 
quite comparable. Thus, it is reasonable to assume that any differences in 
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outcome measures between the two populations are primarily related to UB 
participation . 

A. Increasing High School Retention ■- 

Two types of HS continuance/completion rates were analyzed. Tha first 
was a fall-to-spring (within-school-year) rate; the second a fall-to-fall 
(full-year) rate. The latter rate takes into consideration those students 
who drop out in the summer "^'acation between the academic years. 

The fall-to-spring HS continuance/completion rate within each of grade 
levels 10, 11, aud 12 is higher for the UB group than for the comparison 
group, but the observed differences are statistically significant only for 
grades 10 and 11. Regardless of grade level considered, however, continuance/ 
completion rates for both group^s were quite high , ranging from 93 to 98 
percent. Within the UB group, completion rates for twelfth graders tended 
to increase with the length of time students had spent in the UB program. 

The fall-to-fall HS continuance/completion rate picture is somewhat 
different. As expected, the fall-to-fall rates are lower for both groups, 
ranging from 85 to 93 percent. The only statistically significant rate 
difference was for grade 10, in which che UB students showed higher rates 
(93^ percent vs. 86 percent for the control group). Further, the fall-to- 
fall rate does not appear, to be related to the extent of UB participation. 
A Markov model for educational continuance, using the synthetic cohort 
feature of the study design, indicated that the probability of twelfth 
grade completion, given tenth grade entry, is not significantly related 
to UB participation, regardless of the extent of that participation > 

Based on these analyses, there is little evidence to support the 
hypothesis that the UB p rogram is signi ficantly increasing high school 
retention among its participants. On the other hand, the extent of high 
school dropout is at a relatively limited level on a year-by-yearvbasis , 
although the cumulative? impact over the last 3 high school years is esti- 
mated to approach 30 percent for UB or similar students. 

B . I ncreasing the R a ta of Entry Into PSE 

The most important objective — and the basic mandate of the enabling 
legislation—is to improve the numbers of "disadvantaged" students who 
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enter postsecondary education. The differences in PSE enrollment rates 
betweea the UB and comparison students were found to be both statistically 
and practically significant due to their absolute magnitude — and to be in 
favor of the UB program. Among high school graduates, less than half of 
the comparison students entered PSE as compared to almost three-fourths of 
the UB participants. Among all individuals who could have entered PSE 
(i.e., those not still in HS, including high school dropouts)_> the data 
indicate that 13 of 20 UB students entered PSE as compared to 8 of 20 
comparison students. There is also st:^tistlcal evidence that among HS 
graduates PSE entry rate is positively related to length of participation 
in th e UB program, although the absolute magnitude of the increase is less 
than 10 percent . 

Although the stated objective does not specify placement in any 
particular type of postsecondary institution, most UB students apply to 
and enter A-year institutions . Of those UB students entering postsecondary 
institutions, about 75 percent enrolled in 4-year colleges or universities 
and about 20 percent entered 2-"year junior or community colleges. The 
remaining students iintered vocational, trade, or other .Schools. Comparable 
figures for the entering comparison students were about 45, 30, and 25 
percent, respectively. 

Given these results, it appears that UB participation is positively 
related to immediate entry into postsecondary education, in both a q^uali- 
tative and quantitative sense . The most plausible explanation for this - 
relationship (though not the only one) is that UB program participation, 
per se , significantly raises the probability of student entry into PS£„ 
It sh( aid be noted, however, that the data in this study do noc allow an 
assessment of postsecondary persistence within the two groups, nor do they 
allow examination of hypotheses regarding entry into PSE a year or mor^^ 
after graduation. 

C. Generating Skills and Motivation Necessary for Success in E ducation 
Beyond High School 

The extent to which UB is meeting this objective could not be directly 
and rigorously evaluated due to the dif£ culty in defining and/or measuring 

470 



9.23 



such variables in an essentially cross-sectional study. An indirect evalu- 
ation was conducted, however, by examining differences bet v;een the UB and 
comparison students on factors theoretically and empirically related to 
success ill postsecondary education. Specifically examined were changes 
that occurred in: high school academic measures from ninth grade to current 
grade (grade point average, proportion of academic credits taken, and 
academic credits passed); aspirations and expectations f.r postsecondary 
education; and actions taken in preparation for poj^ ' !ary education. 

There is no support for a relationship between Uh ^articipc tion and 
change in academic factors. There is evidence , however, that greater 
proportions of UB participants planned and expected to attend and complete 
PSE. There is also evidence to s upport the hypothesis that the UB program 
is faci litati ng actions taken by students in preparation for FSE, including 
application . The data further indicate that proportionally more UB appli- 
cants to PSE institutions apply for financial aid than do eqc-rlvalent groups 
of comparison students; and that while UB aid applicants do not receive 
more offers of aid, they do receive more adequate offers (generally in the 
form of larger grants) . 

The overall thrust of these results suggests that the UB program is 
providing supportive, advocacy, and advisory services that facilitate 
entrance into PSE. Considering the limitat:^,ons of much of the data used 
to produce the results reported in this subsection (e.g., the question- 
able nature of the particular measures used and the attenuation of data 
due to large ainounts of indeterminate responses and/or a small number of 
cases) , these results are less reliable than those involving HS continuance 
or PSE entry; however, they support and help t:o explain the higher PSE 
entry rates found for UB program sci^dents. 

IV. SUMMARY AND INTERPRETATIONS OF MAJOR FINDINGS: THE 
RELATIONSHIPS OF STUDENT OUTCOMES TO PROJECT CHARACTERISTICS 

Sample data were explored in an attempt to establish relationships of 
specific project functional and structural characteristics with student 
outcome measures. The statistical methods of multiple discriminant analysis 
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and multiple regression analysis were used in these exploratory analyses. 
One general theme was reflected in the majority of analyses: the preprocess 
characteristics of the students served by a project were consistently 
related to project level outcomes as measured in this study ; hoyeyer, 
when student p reproce ss differences were controlled, there remained, at 
best, weak relationships between project process measures and Jjroject 
levfel outcomes . The relevant student characteristics include: ninth grade 
GPA and academic course load, the proportion of poverty level students in 
the project, the number of students in the project, the percent of male 
ytudent3, and the proportions of students who were juiiiors and seniors. 
The basic finding suggests that the higher the level of input (e.g., higher 
ninth grade GPA, lower proportions of academic risk students), the more 
likely the project was to achieve the basic goal of inducing or experiencing 
high PSE entry rates. This relationship does not provide any useful infor- 
mation for program-level decisionmaking, since any project can determine, 
through selection procedures, the academic quality of participants (within 
the constraints of the program guidelines) , 

There was ona srall but relatively consistent hint of a relationship 
between a few academir. year activities and the outcome measures considered. 
Tne pattern of this weak findiag is sugge&tive of a possible relationship 
between level of academic year program activity' and student outcomes. 
There are, however, other plausible explanations of this pattern. 

Other ^relationships between program procv:i;iS and output measures did 
not appear stable, consistent, or conceptually reasonable. The most pre- 
dictive relationships between process measures and the individual student 
outcomes were given by models that were quail ' lively different. Such a 
lack of internal consistency is especially di-;cuncerting in a case such as 
this in which many of the output measures are conceptually similar and 
correlated. Further, .the partial correlations between student outcomes and 
some project characteristics were negative, suggesting counterintuitive 
relationships ijuch as that of project emphasis on academic coun. -ruling being 
associated with lower postsecondary entry rates. Given that one of the 
dangers of the stepwise analysis techniques used is that they capj. Jilize on 
chance sampling fluctuations, the inconsiGtent relationships were dismissed 
as artif actual. 
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The failure to discover any systematic set of project characteristics 
that were related to project success is disturbing and counterintuitive, 
particularly in light of the latitude allowed in these analyses. It could 
be that such relationships do not exist, although such an interpre::ation is 
illogical. On the other hand, lack of observed relationship could be 
attributed to jiany other causes — measurement error, inappropriate choice of 
variables, or inappropriate analysis models, to name but a few. One 
reasonable explanation is that measurement error and relative pervr.sive 
relationships between input and output jointly mask any existing relation- 
ships between process and output. If this is the case, then either the 
relationships are relatively weak or the measurement error is large, or 
both. 

Another possible explanation of this pattern oi negative findings (and 
one that is supported by observations during site visiub) is that input 
measures and process measures are confounded . That is, different processes 
are used because different types of students are selected, and different 
students are selected because a program has geared its process to that 
particular ^.ype of student. With this type of confounding, statistical 
adjustments for input differences, such as those used in Lhese analyses, 
would tend to wash out any effects due to process. This explanation is 
quite consistent with the study findings, but to investigate the hypothesis 
more fully would require different approaches to both design and measure-- 
ment than those employed in this study. 
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